-- Logs begin at Mon 2022-09-26 04:47:42 UTC, end at Mon 2022-09-26 05:47:41 UTC. -- Sep 26 05:20:28.897717 dv-cinder-859186-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 26 05:20:28.906359 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 26 05:20:28.909183 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 26 05:20:28 2022] *** Sep 26 05:20:28.909183 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 26 05:20:28.909183 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 26 05:20:28.909183 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: nodename: dv-cinder-859186-2-iscsi Sep 26 05:20:28.909183 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: machine: x86_64 Sep 26 05:20:28.909183 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: clock source: unix Sep 26 05:20:28.909183 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: pcre jit disabled Sep 26 05:20:28.909183 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: detected number of CPU cores: 4 Sep 26 05:20:28.909183 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: current working directory: / Sep 26 05:20:28.909183 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: detected binary path: /usr/bin/uwsgi-core Sep 26 05:20:28.909882 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: your processes number limit is 47680 Sep 26 05:20:28.909882 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: your memory page size is 4096 bytes Sep 26 05:20:28.909882 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: detected max file descriptor number: 2048 Sep 26 05:20:28.909882 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: lock engine: pthread robust mutexes Sep 26 05:20:28.909882 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: thunder lock: enabled Sep 26 05:20:28.909882 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 26 05:20:28.909882 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 26 05:20:28.947508 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: Python main interpreter initialized at 0x56152a1a69c0 Sep 26 05:20:28.947508 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: python threads support enabled Sep 26 05:20:28.947508 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: your server socket listen backlog is limited to 100 connections Sep 26 05:20:28.947508 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: your mercy for graceful operations on workers is 90 seconds Sep 26 05:20:28.947821 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: mapped 403077 bytes (393 KB) for 2 cores Sep 26 05:20:28.947922 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: *** Operational MODE: preforking *** Sep 26 05:20:28.948183 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: *** uWSGI is running in multiple interpreter mode *** Sep 26 05:20:28.948183 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: spawned uWSGI master process (pid: 105557) Sep 26 05:20:28.948381 dv-cinder-859186-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 26 05:20:28.948929 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: spawned uWSGI worker 1 (pid: 105558, cores: 1) Sep 26 05:20:28.952273 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: spawned uWSGI worker 2 (pid: 105559, cores: 1) Sep 26 05:20:28.952273 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 26 05:20:29.606805 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 05:20:29.613438 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 05:20:30.695774 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:20:30.695774 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: from cryptography.utils import int_from_bytes Sep 26 05:20:30.696424 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:20:30.696424 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: from cryptography.utils import int_from_bytes Sep 26 05:20:30.698891 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:20:30.698891 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: from cryptography.utils import int_from_bytes Sep 26 05:20:30.699315 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:20:30.699315 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: from cryptography.utils import int_from_bytes Sep 26 05:20:33.188415 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 05:20:33.188947 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 05:20:33.189186 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 05:20:33.189543 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 05:20:33.189794 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 05:20:33.190173 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.190495 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.190815 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.191102 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 05:20:33.191463 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.191558 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 05:20:33.191637 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.191738 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.191894 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 05:20:33.192054 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.192276 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 05:20:33.192404 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.192551 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 05:20:33.192730 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.192944 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.193040 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.193271 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.193358 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.193592 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859186-2-iscsi {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.193682 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.193908 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.193994 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.194210 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.194319 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.194516 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.194613 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.194826 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.194919 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.195126 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.195211 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.195443 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.195528 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.195702 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.195865 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.196020 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.196224 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.196358 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859186-2-iscsi {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.196682 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.196831 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.196996 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.197089 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.197287 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.197393 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.197599 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.197702 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.197904 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.198066 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.198210 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.198356 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.198510 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.198654 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.198815 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.199013 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.199134 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.199323 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.199423 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.199628 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.199820 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859186-2-iscsi {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.199936 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.200134 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.200290 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.200465 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.200609 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.200774 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.200919 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.201180 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.201267 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.201489 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.201574 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.201797 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.201916 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.202115 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.202224 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.202436 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.202617 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859186-2-iscsi {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.202744 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.202849 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.203585 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.203728 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.203911 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.204197 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.204324 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.204554 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.204654 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.204856 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.204961 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.205161 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.205260 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.205491 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.205580 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.205859 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.205948 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.206177 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.206267 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.206482 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.206577 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.206730 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.206819 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.207035 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.207123 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.207433 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.207551 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.207732 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.207817 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.208046 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.208144 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.208347 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.208453 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.208599 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.208689 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.208915 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.209003 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.209235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.209333 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.209507 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.209594 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.209818 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.209916 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.210141 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.210412 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.210501 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.210721 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.210808 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.211009 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.211106 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.211260 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.211350 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.211579 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.211678 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.211896 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.212013 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.212210 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.212360 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.212543 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.212673 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.212861 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.212982 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.213173 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.213287 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.213489 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.213590 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.213882 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.213971 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.214128 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.214221 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.214433 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.214532 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.214769 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.214866 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.215082 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.215167 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.215388 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.215488 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.215692 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.215777 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.216005 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.216090 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.216332 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.216442 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.216637 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.216724 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.216941 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.217032 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.217256 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.217351 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.217589 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.217674 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.217892 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.218060 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.218213 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.218350 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.218485 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.218620 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.219422 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.219522 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.219678 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.219822 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.219964 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.220099 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.220236 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.220386 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.220539 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.220686 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.220823 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.220957 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.221093 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.221231 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.221376 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.221522 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.221657 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.221791 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.221933 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.222081 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.222217 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.222365 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.222508 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.222642 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.222793 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.222943 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.223088 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.223245 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.223386 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.223588 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.223749 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.223950 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.224118 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.224289 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.224587 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.224676 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.224890 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.225193 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.225291 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.225533 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.225721 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.225898 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.226236 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.226345 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.226644 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.226722 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.226965 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.227218 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.227295 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.227566 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.227708 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.227879 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.228209 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.228342 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.228513 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.228710 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.228830 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.229130 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.229216 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.229436 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.229683 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.229779 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.230041 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.230148 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.230344 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.230640 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.230811 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.230955 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.231099 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.231202 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.231509 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.231608 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.231808 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.232061 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.232149 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.232415 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.232578 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.232732 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.233049 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.233138 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.233361 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.233548 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.233664 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.233965 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.234069 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.234279 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.234538 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.234682 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.234972 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.235110 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.235309 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.235486 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.235620 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.235950 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.236037 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.236564 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.236723 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.236882 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.237195 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.237281 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.237507 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.237691 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.237831 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.238140 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.238226 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.238450 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.238646 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.238745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.239060 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.239160 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.239379 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.239578 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.239708 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.240024 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.240130 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.240359 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.240540 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.240676 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.240986 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.241075 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.241303 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.241478 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.241630 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.241949 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.242047 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.242254 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.242451 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.242593 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.242936 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.243023 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.243256 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.243477 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.243588 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.243886 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.244020 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.244184 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.244387 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.244517 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.244823 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.244911 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:20:33.245163 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.245401 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.245498 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.245770 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.245919 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.246086 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.246398 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.246495 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.246716 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.246927 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.247016 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.247319 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.247443 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.247626 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.247934 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.248023 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.248241 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.248477 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.248595 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.248907 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.248996 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.249226 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.249441 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.249530 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.249836 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.249980 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.250223 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.250473 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.250639 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.250815 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.250965 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.251124 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.251428 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.251523 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.251729 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.251946 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.252045 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.252352 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.252478 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.252656 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.252973 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.253061 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.253303 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.253491 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.253610 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.253923 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.254051 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.254227 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.254475 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.254568 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.254826 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.254969 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.255139 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.255439 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.255542 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.255746 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.255966 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.256065 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.256366 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.256501 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.256691 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.256995 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.257085 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.257295 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.257532 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.257700 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.257901 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.258077 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.258205 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.258515 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.258602 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.258827 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.258926 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.259135 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.259258 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.259445 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.259582 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.259753 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.259902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.260074 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.260220 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.260408 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.260592 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.260717 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.260968 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.261064 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.261289 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.261378 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.261615 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.261705 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.261936 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.262024 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.262264 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.262353 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.262576 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.262671 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.262878 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.263032 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.263193 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.263496 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.263591 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.263797 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.263990 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.264164 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.264418 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.264536 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.264715 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.265016 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.265106 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.265314 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.265505 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.266201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.266525 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.266620 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.266962 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.267051 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.267274 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.267494 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.267584 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.267864 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.267985 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.268165 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.268495 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.268606 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.268821 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.268981 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.269157 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.269462 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.269561 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.269787 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.269964 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.270107 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.270416 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.270504 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.270728 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.270873 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.271034 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.271196 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.271343 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.271508 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.271650 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.271838 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.271959 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.272171 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.272280 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.272548 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.272648 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.272896 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.272983 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.273203 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.273292 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.273518 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.273606 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.273828 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.273915 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.274140 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.274226 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.274443 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.274562 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.274755 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.274934 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.275090 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.275419 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.275535 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.275732 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.275894 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.276379 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.276472 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.276695 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.276885 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.277001 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.277309 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.277404 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.277617 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.277843 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.277933 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.278225 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.278313 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.278532 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.278768 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.278858 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.279136 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.279255 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.279454 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.279734 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.279832 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.280060 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.280221 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.280381 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.280690 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.280778 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.281013 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.281287 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.282082 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.282360 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.282533 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.282732 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.282835 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.283052 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.283140 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.283361 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.283448 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.283668 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.283759 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.283984 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.284080 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.284314 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.284434 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.284618 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.284721 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.284924 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.285022 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.285235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.285333 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.285541 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.285639 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.285848 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.285946 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.286149 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.286247 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.286459 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.286657 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.286755 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.287048 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.287152 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.287346 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.287590 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.287695 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.287959 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.288065 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.288284 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.288545 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.288644 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.288913 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.289015 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.289215 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.289471 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.289578 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.289819 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.289965 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.290126 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.290427 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.290515 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.290727 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.290890 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.291029 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.291370 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.291459 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.291680 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.291898 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.291987 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.292298 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.292453 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.292621 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.292927 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.293016 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.293236 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.293533 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.293633 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.293839 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.293985 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.294156 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.294314 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.294468 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.294649 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.294758 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.294972 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.295071 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.295295 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.295393 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.295613 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.295720 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.295945 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.296042 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.296272 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.296384 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.296592 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.296698 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.296956 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.297082 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.297335 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.297551 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.297829 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.298041 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.298315 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.298438 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.298761 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.298856 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.299282 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.299418 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.299654 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.299777 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.299971 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.300273 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.300382 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.300644 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.300764 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.300962 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.301284 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.301372 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.301610 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.301797 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.301921 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.302223 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.302310 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.302531 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.302769 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.302870 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.303123 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.303261 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.303429 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.303733 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.303827 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.304037 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.304237 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.304365 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.304655 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.304798 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.304957 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.305258 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.305347 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.305557 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.305749 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.305856 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.306154 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.306275 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.306454 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.306581 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.306758 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.306906 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.307059 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.307223 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.307377 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.307553 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.307682 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.307869 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.307969 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.308193 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.308303 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.308526 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.308615 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.308843 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.308944 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.309175 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.309263 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.309503 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.309591 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.309815 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.309915 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.310130 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.310219 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.310439 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.310527 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.310737 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.310834 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.311053 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.311139 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.311350 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.311445 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.311650 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.311739 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.311947 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.312042 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.312268 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.312371 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.312611 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.312711 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.312912 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.313221 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.313326 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.313505 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.313604 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.313811 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.313898 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.314115 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.314205 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.314416 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.314514 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.314718 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.314805 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.315018 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.315125 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.315324 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.315414 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.315629 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.315724 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.315929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.316029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.316222 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.316380 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.316556 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.316646 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.316858 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.316954 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.317155 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.317245 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.317460 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.317548 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.317759 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.317855 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.318067 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.318155 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.318362 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.318451 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.318662 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.318758 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.318959 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.319054 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.319262 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.319351 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.319563 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.319659 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.319861 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.319956 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.320175 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.320290 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.320506 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.320677 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.320806 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.320903 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.321104 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.321193 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.321407 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.321498 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.321705 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.321792 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.322005 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.322094 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.322310 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.322399 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.322626 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.322714 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.322937 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.323036 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.323235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.323325 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.323539 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.323627 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.323842 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.323939 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.324141 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.324231 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.324466 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.324557 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.324770 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.324881 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.325071 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.325198 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.325371 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.325472 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.325667 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.325782 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.325964 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.326237 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.326336 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.326565 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.326674 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.326868 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.326966 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.327168 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.327265 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.327465 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.327564 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.327763 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.327879 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.328656 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.328799 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.328961 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.329121 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.329347 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.329464 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.329654 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.329745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.329965 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.330061 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.330273 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.330378 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.330579 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.330675 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.330892 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.330987 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.331199 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.331296 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.331505 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.331593 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.331810 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.331899 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.332121 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.332210 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.332448 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.332538 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.332747 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.332834 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.333049 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.333148 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.333352 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.333439 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.333661 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.333757 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.333963 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.334052 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.334275 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.334384 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.334582 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.334740 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.334900 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.334987 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.335200 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.335296 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.335503 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.335603 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.335807 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.335894 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.336109 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.336197 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.336454 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.336556 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.336760 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.336849 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.337066 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.337156 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.337376 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.337474 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.337684 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.337781 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.337990 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.338086 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.338298 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.338394 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.338600 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.338689 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.338905 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.338994 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.339208 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.339296 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.339508 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.339603 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.339814 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.339902 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.340119 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.340214 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.340443 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.340533 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.340746 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.340851 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.341046 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.341136 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.341353 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.341441 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.341651 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.341755 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.341950 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.342076 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.342258 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.342386 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.342561 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.342694 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.342872 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.342994 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.343179 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.343300 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.343482 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.343591 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.344359 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.344555 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.344720 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.344878 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.344965 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.345156 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.345247 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.345560 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.345650 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.345864 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.345963 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.346170 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.346303 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.346453 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.346532 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.346758 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.346857 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.347056 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.347150 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.347361 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.347457 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.347668 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.347836 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.347969 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.348057 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.348286 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.348419 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.348591 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.348696 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.348910 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.348999 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.349209 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.349296 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.349520 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.349666 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.349808 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.349945 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.350112 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.350262 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.350408 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.350545 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.350729 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.350882 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.351046 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.351186 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.351352 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.351499 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.351662 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.351808 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.351967 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.352105 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.352287 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.352423 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.352570 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.352706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.352876 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.353025 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.353161 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.353296 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.353467 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.353614 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.353772 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.353924 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.354063 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.354209 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.354350 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.354512 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.354650 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.354801 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.354959 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.355118 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.355257 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.355438 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.355573 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.355749 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.355887 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.356066 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.356207 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.356483 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.356592 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.356805 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.356894 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.357112 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.357202 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.357431 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.357527 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.357749 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.357837 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.358051 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.358140 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.358352 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.358450 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.358657 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.358746 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.359003 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.359096 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.359256 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.359365 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.359603 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.359831 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.360001 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.360125 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.360230 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.360380 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.360510 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.360599 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.360814 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.360905 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.361113 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.361464 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.361676 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.361773 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.361994 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.362081 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.362294 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.362393 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.362612 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.362701 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.362917 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.363004 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.363227 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.363316 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.363540 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.363636 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.363843 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.363945 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.364149 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.364279 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.364483 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.364574 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.364782 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.364879 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.365082 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.365205 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.365380 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.365471 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.365688 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.365784 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.365997 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.366096 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.366304 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.366394 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.366616 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.366714 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.366923 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.367021 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.367228 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.367318 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.367552 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.367641 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.367860 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.367959 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.368163 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.368271 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.368496 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.368586 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.368800 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.368890 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.369112 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.369214 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.369413 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.369500 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.369715 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.369855 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.370024 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.370137 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.370328 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.370447 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.370631 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.370753 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.370931 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.371063 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.371238 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.371373 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.371538 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.371688 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.371838 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.372000 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.372138 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.372325 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.372480 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.372740 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.372837 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.373055 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.373143 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.373367 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.373458 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.373670 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.373756 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.373971 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.374069 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.374271 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.374360 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.374577 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.374665 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.374901 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.375008 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.375251 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.375422 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.375580 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.375756 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.375866 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.375968 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.376181 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.376297 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.376519 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.376608 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.376832 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.376935 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.377145 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.377305 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.377457 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.377623 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.377769 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.377932 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.378080 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.378348 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.378437 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.378663 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.378751 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.378975 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.379072 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.379285 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.379380 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.379611 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.379798 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.379941 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.380127 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.380217 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.380480 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.380586 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.380793 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.380890 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.381104 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.381193 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.381415 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.381504 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.381725 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.381815 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.382035 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.382124 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.382343 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.382431 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.382649 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.382747 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.382956 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.383046 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.383282 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.383388 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.383600 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.383697 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.383922 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.384018 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.384270 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.384377 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.384594 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.384683 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.384906 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.385112 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.385205 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.385296 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.385541 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.385638 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.385854 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.385958 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.386164 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.386260 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.386467 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.386565 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.386770 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.386860 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.387082 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.387171 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.387385 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.387512 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.387692 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.387782 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.387999 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.388089 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.388332 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.388427 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.388637 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.388735 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.388940 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.389036 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.389245 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.389337 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.389551 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.389649 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.389859 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.389948 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.390173 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.390271 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.390494 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.391086 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.391381 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.391537 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.391731 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.391884 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.392040 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.392153 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.392376 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.392481 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.392792 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.392882 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.393100 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.393191 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.393407 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.393505 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.393752 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.393845 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.394067 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.394158 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.394389 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.394478 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.394714 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.394804 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.395042 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.395181 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.395345 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.395434 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.395645 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.395742 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.395951 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.396040 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.396284 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.396390 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.396577 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.396719 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.397029 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.397133 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.397223 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.397305 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.397484 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.397586 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.397797 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.397886 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.398102 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.398192 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.398421 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.398630 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.398720 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.398984 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.399082 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.399304 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.399416 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.399606 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.399694 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.399911 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.400001 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.400216 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.400392 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.400561 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.400658 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.400867 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.400957 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.401177 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.401274 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.401483 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.401572 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.401801 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.401946 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.402111 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.402256 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.402554 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.402699 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.402900 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.402999 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.403207 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.403298 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.403538 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.403627 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.403848 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.403937 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.404176 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.404287 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.404505 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.404593 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.404827 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.404915 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.405131 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.405264 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.405435 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.405524 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.405739 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.405828 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.406050 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.406139 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.406974 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.407173 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.407332 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.407493 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.407622 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.407779 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.407922 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.408103 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.408235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.408503 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.408604 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.408857 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.409036 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.409160 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.409371 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.409469 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.409691 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.409805 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.410009 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.410116 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.410325 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.410434 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.410642 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.410740 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.410959 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.411057 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.411275 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.411365 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.411591 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.411688 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.411897 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.411985 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.412210 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.412320 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.412546 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.412635 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.412856 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.412945 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.413184 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.413273 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.413497 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.413585 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.413910 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.414012 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.414232 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.414348 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.414549 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.414669 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.414865 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.415009 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.415221 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.415374 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.415541 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.415645 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.415851 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.415950 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.416166 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.416275 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.416520 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.416628 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.416838 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.416929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.417146 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.417233 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.417455 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.417544 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.417766 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.417857 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.418075 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.418172 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.418382 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.418470 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.418688 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.418784 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.418996 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.419085 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.419302 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.419399 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.419610 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.419708 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.419917 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.420007 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.420222 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.420375 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.420555 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.420653 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.420862 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.420958 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.421173 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.421270 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.421510 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.421689 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.421850 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.422116 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.422252 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.422460 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.422672 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.422891 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.422990 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.423204 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.423304 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.423514 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.423628 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.423823 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.423954 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.424131 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.424311 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.424470 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.424630 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.424804 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.424937 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.425117 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.425251 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.425440 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.425565 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.425872 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.426094 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.426194 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.426409 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.426498 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.426725 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.426815 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.427043 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.427141 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.427355 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.427453 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.427674 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.427908 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.427997 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.428270 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.428363 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.428600 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.428689 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.428918 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.429017 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.429243 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.429330 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.429561 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.429659 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.429870 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.429968 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.430196 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.430285 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.430498 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.430630 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.430799 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.430902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.431099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.431188 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.431406 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.431494 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.431711 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.431815 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.432015 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.432101 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.432338 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.432430 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.432640 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.432775 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.432943 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.433044 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.433241 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.433337 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.433540 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.433631 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.433840 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.433928 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.434138 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.434235 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.434441 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.434531 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.434741 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.434829 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.435040 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.435128 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.435338 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.435427 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.435635 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.435736 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.435933 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.436031 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.436232 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.436347 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.436557 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.436646 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.436857 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.436955 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.437157 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.437254 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.437504 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.437657 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.437815 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.437980 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.438160 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.438250 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.438474 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.438562 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.438779 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.438880 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.439105 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.439195 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.439411 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.439500 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.439716 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.439806 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.440032 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.440120 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.440370 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.440463 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.440696 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.440793 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.441009 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.441098 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.441321 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.441410 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.441629 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.441717 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.441959 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.442049 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.442269 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.442501 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.442682 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.442825 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.442973 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.443153 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.443303 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.443462 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.443552 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.443770 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.443877 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.444092 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.444187 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.444426 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.444517 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.444734 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.444822 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.445057 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.445145 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.445370 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.445469 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.445684 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.445795 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.445993 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.446093 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.446303 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.446390 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.446616 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.446717 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.446923 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.447087 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.447233 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.447322 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.447537 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.447624 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.447846 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.447943 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.448152 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.448239 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.448486 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.448576 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.448795 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.448883 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.449103 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.449191 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.449413 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.449511 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.449723 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.449811 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.450049 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.450137 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.450368 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.450464 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.450676 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.450764 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.450992 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.451087 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.451310 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.451407 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.451621 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.451711 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.451932 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.452020 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.452241 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.452361 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.452573 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.452662 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.452891 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.452979 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.453764 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.453938 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.454098 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.454296 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 05:20:33.454451 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.454675 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.455351 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.455705 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.456003 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.456356 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.456677 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.457003 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.457331 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.457649 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.457973 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.458286 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.458617 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.458958 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.459287 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.459616 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.459925 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.460233 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.460564 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.460878 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.461199 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.461510 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.461815 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.462120 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.462432 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.462738 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.463046 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.463350 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.463657 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.463966 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.464306 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.464598 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.464901 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.465205 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.465510 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.465814 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.466125 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.466430 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.466734 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.467344 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.467647 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.467978 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.468338 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.468674 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.469532 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.469844 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.470168 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.470481 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.470805 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.471132 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.471452 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.471765 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.472098 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.472434 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.472749 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.473064 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.473377 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.473695 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.474006 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.474334 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.474659 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.474967 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.475293 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.475616 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.475939 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.476273 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.476594 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.476927 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.477240 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.477553 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.477867 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.478179 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.478493 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.478813 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.479127 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.479441 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.479761 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.480081 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.480448 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.480779 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.481093 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.481421 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.481748 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.482107 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.482423 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.482771 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.483101 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.483419 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.483742 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.484050 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:20:33.484345 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 05:20:33.612361 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO dbcounter [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] Registered counter for database nova_api Sep 26 05:20:33.633010 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_db.sqlalchemy.engines [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:20:33.639535 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG dbcounter [-] [105558] Writer thread running {{(pid=105558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:20:33.653279 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO dbcounter [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] Registered counter for database nova_api Sep 26 05:20:33.679977 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG oslo_db.sqlalchemy.engines [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:20:33.686355 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG dbcounter [-] [105559] Writer thread running {{(pid=105559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:20:33.695453 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.context [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f676b63-1e10-465f-9e48-7eb519e23a3a(cell1) {{(pid=105558) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 05:20:33.699357 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:20:33.699820 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:20:33.701426 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:20:33.702162 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:20:33.702575 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:20:33.705140 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:20:33.707128 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO dbcounter [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] Registered counter for database nova_cell0 Sep 26 05:20:33.711232 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO dbcounter [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] Registered counter for database nova_cell1 Sep 26 05:20:33.718318 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_db.sqlalchemy.engines [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:20:33.720094 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_db.sqlalchemy.engines [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:20:33.725838 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG dbcounter [-] [105558] Writer thread running {{(pid=105558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:20:33.727590 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG dbcounter [-] [105558] Writer thread running {{(pid=105558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:20:33.743538 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.context [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f676b63-1e10-465f-9e48-7eb519e23a3a(cell1) {{(pid=105559) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 05:20:33.747460 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG oslo_concurrency.lockutils [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:20:33.747928 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG oslo_concurrency.lockutils [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:20:33.749557 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG oslo_concurrency.lockutils [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:20:33.750797 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG oslo_concurrency.lockutils [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:20:33.751245 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG oslo_concurrency.lockutils [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:20:33.753268 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG oslo_concurrency.lockutils [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:20:33.755251 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO dbcounter [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] Registered counter for database nova_cell0 Sep 26 05:20:33.759206 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO dbcounter [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] Registered counter for database nova_cell1 Sep 26 05:20:33.768991 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG oslo_db.sqlalchemy.engines [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:20:33.770688 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG oslo_db.sqlalchemy.engines [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:20:33.776567 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG dbcounter [-] [105559] Writer thread running {{(pid=105559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:20:33.778338 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG dbcounter [-] [105559] Writer thread running {{(pid=105559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:20:33.870883 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO dbcounter [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] Registered counter for database nova_cell0 Sep 26 05:20:33.879999 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_db.sqlalchemy.engines [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:20:33.884595 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG dbcounter [-] [105558] Writer thread running {{(pid=105558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:20:33.923868 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO dbcounter [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] Registered counter for database nova_cell0 Sep 26 05:20:33.932774 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG oslo_db.sqlalchemy.engines [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:20:33.937594 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG dbcounter [-] [105559] Writer thread running {{(pid=105559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:20:34.228704 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: WARNING keystonemiddleware.auth_token [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 05:20:34.236868 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: WARNING keystonemiddleware.auth_token [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 05:20:34.281977 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: WARNING keystonemiddleware.auth_token [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 05:20:34.293651 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: WARNING keystonemiddleware.auth_token [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 05:20:34.581759 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: WARNING keystonemiddleware.auth_token [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 05:20:34.587755 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: WARNING keystonemiddleware.auth_token [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 05:20:34.593174 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56152a1a69c0 pid: 105558 (default app) Sep 26 05:20:34.596100 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:20:34.597316 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001795 Sep 26 05:20:34.597730 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Mon Sep 26 05:20:34 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:20:34.640629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: WARNING keystonemiddleware.auth_token [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 05:20:34.646836 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: WARNING keystonemiddleware.auth_token [None req-d6ca2d45-c015-492e-afbb-0748deb43f8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 05:20:34.652232 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56152a1a69c0 pid: 105559 (default app) Sep 26 05:21:56.587112 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:21:56.589300 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002596 Sep 26 05:21:56.589704 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 05:21:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:21:56.606845 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG dbcounter [-] [105559] Writing DB stats nova_api:SELECT=3 {{(pid=105559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:56.610659 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG dbcounter [-] [105559] Writing DB stats nova_cell1:SELECT=3 {{(pid=105559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:56.611613 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG dbcounter [-] [105559] Writing DB stats nova_cell0:SELECT=3 {{(pid=105559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:56.612815 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG dbcounter [-] [105559] Writing DB stats nova_cell0:SELECT=3 {{(pid=105559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:57.469738 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-0337645e-d966-43ab-84f5-f07b56208350 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:21:57.501892 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-0337645e-d966-43ab-84f5-f07b56208350 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.905229 Sep 26 05:21:57.502619 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1292 bytes} [Mon Sep 26 05:21:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:22:00.144427 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:00.145298 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-a90fba50-f5ec-4d97-a073-b608ffba7b00 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 26 05:22:00.145859 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 05:22:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:22:00.600405 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-e514727b-502f-43d2-94a0-b9acf87e1e5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "ram": 256, "disk": 1}} {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:00.648572 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-e514727b-502f-43d2-94a0-b9acf87e1e5d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.496645 Sep 26 05:22:00.649128 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 05:22:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 05:22:00.662833 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG dbcounter [-] [105558] Writing DB stats nova_api:SELECT=3 {{(pid=105558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:00.663637 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG dbcounter [-] [105558] Writing DB stats nova_cell1:SELECT=3 {{(pid=105558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:00.665601 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG dbcounter [-] [105558] Writing DB stats nova_cell0:SELECT=3 {{(pid=105558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:00.666349 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG dbcounter [-] [105558] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:00.873122 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-a96ed51c-d117-4bca-b46b-3730134eb7df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:00.941453 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-a96ed51c-d117-4bca-b46b-3730134eb7df admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283761 Sep 26 05:22:00.942040 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1336 bytes} [Mon Sep 26 05:22:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:22:03.560938 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-e514727b-502f-43d2-94a0-b9acf87e1e5d admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:03.561960 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-e514727b-502f-43d2-94a0-b9acf87e1e5d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 26 05:22:03.562373 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 05:22:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:22:04.235853 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-85b89819-a924-49b7-9fbe-dd2bf0663558 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1", "ram": 512, "name": "ds512M", "swap": 0, "disk": 5}} {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:04.279304 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-85b89819-a924-49b7-9fbe-dd2bf0663558 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.710574 Sep 26 05:22:04.280294 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 05:22:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:22:04.292873 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-bff5ca85-a12e-49e7-abc6-5d7759d02303 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:04.331722 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-bff5ca85-a12e-49e7-abc6-5d7759d02303 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042992 Sep 26 05:22:04.332672 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1336 bytes} [Mon Sep 26 05:22:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:22:06.941591 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-85b89819-a924-49b7-9fbe-dd2bf0663558 admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:06.942604 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-85b89819-a924-49b7-9fbe-dd2bf0663558 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 26 05:22:06.943011 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 05:22:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:22:07.371448 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-74193a33-7b8e-4c8a-8b0e-0482f3af21ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "name": "ds1G", "id": "d2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10}} {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:07.390365 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-74193a33-7b8e-4c8a-8b0e-0482f3af21ce admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.440726 Sep 26 05:22:07.390844 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 05:22:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 05:22:07.403675 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-85348720-2570-4c0c-92be-e7378feac307 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:07.433370 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-85348720-2570-4c0c-92be-e7378feac307 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033715 Sep 26 05:22:07.433788 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1336 bytes} [Mon Sep 26 05:22:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:22:10.104334 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-74193a33-7b8e-4c8a-8b0e-0482f3af21ce admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:10.105923 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-74193a33-7b8e-4c8a-8b0e-0482f3af21ce admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002070 Sep 26 05:22:10.111576 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 05:22:10 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:22:10.519650 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-2531b61d-de66-4f57-aa71-472d394eef1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "ram": 2048, "vcpus": 2, "id": "d3"}} {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:10.539081 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-2531b61d-de66-4f57-aa71-472d394eef1b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.426134 Sep 26 05:22:10.540294 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 05:22:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:22:10.552107 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-829fd91f-6acc-433e-bbc5-badf10f6d1c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:10.580362 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-829fd91f-6acc-433e-bbc5-badf10f6d1c5 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031922 Sep 26 05:22:10.581282 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1336 bytes} [Mon Sep 26 05:22:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:22:13.385838 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-2531b61d-de66-4f57-aa71-472d394eef1b admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:13.386755 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-2531b61d-de66-4f57-aa71-472d394eef1b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 26 05:22:13.387182 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 05:22:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:22:13.820014 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-b08473bb-e5f0-4594-84d9-a12b8fb7af0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "ram": 4096, "id": "d4", "swap": 0}} {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:13.842094 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-b08473bb-e5f0-4594-84d9-a12b8fb7af0b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448636 Sep 26 05:22:13.842888 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 05:22:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:22:13.857036 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-01ca6f11-68b6-4b25-af1c-29979911d080 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:13.882095 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-01ca6f11-68b6-4b25-af1c-29979911d080 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028767 Sep 26 05:22:13.882822 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1336 bytes} [Mon Sep 26 05:22:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:22:16.521637 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-b08473bb-e5f0-4594-84d9-a12b8fb7af0b admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:16.522513 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-b08473bb-e5f0-4594-84d9-a12b8fb7af0b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 26 05:22:16.522930 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 05:22:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:22:16.939319 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-fc2ed48a-bac4-4df3-89d0-aa5a092dea48 admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:16.970653 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-fc2ed48a-bac4-4df3-89d0-aa5a092dea48 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.440855 Sep 26 05:22:16.971326 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1292 bytes} [Mon Sep 26 05:22:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:22:19.600088 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-b08473bb-e5f0-4594-84d9-a12b8fb7af0b admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:19.601127 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-b08473bb-e5f0-4594-84d9-a12b8fb7af0b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001807 Sep 26 05:22:19.601570 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 05:22:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:22:20.015627 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-1708d6dc-97ce-4505-8707-45e62a64d8b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "ram": 512}} {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:20.035326 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-1708d6dc-97ce-4505-8707-45e62a64d8b3 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.425710 Sep 26 05:22:20.035868 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 05:22:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:22:20.049041 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-3e4c7045-745b-48d8-a46f-7145c3f4421d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:20.079498 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-3e4c7045-745b-48d8-a46f-7145c3f4421d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034977 Sep 26 05:22:20.080232 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1333 bytes} [Mon Sep 26 05:22:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:22:22.881793 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-1708d6dc-97ce-4505-8707-45e62a64d8b3 admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:22.882803 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-1708d6dc-97ce-4505-8707-45e62a64d8b3 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 26 05:22:22.883202 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 05:22:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:22:23.292349 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-b45e8c4d-e913-4d63-93da-e24243c6a55c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "disk": 20, "name": "m1.small", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:23.311810 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-b45e8c4d-e913-4d63-93da-e24243c6a55c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.422615 Sep 26 05:22:23.312417 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 05:22:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 05:22:23.324665 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-db8031de-fe45-4c0e-886a-edfa098da5c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:23.348263 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-db8031de-fe45-4c0e-886a-edfa098da5c8 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027397 Sep 26 05:22:23.348851 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1333 bytes} [Mon Sep 26 05:22:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:22:25.973384 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-b45e8c4d-e913-4d63-93da-e24243c6a55c admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:25.974663 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-b45e8c4d-e913-4d63-93da-e24243c6a55c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002375 Sep 26 05:22:25.975081 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 05:22:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:22:26.374145 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-9d86084a-d1a0-4c9b-9469-6728ef8d68c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium", "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40}} {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:26.399071 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-9d86084a-d1a0-4c9b-9469-6728ef8d68c8 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.417416 Sep 26 05:22:26.400715 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 05:22:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:22:26.412510 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-e1b5a91c-9bd4-4307-9db8-ef05fd33ee39 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:26.439969 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-e1b5a91c-9bd4-4307-9db8-ef05fd33ee39 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031293 Sep 26 05:22:26.440858 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1333 bytes} [Mon Sep 26 05:22:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:22:29.091003 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-9d86084a-d1a0-4c9b-9469-6728ef8d68c8 admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:29.092674 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-9d86084a-d1a0-4c9b-9469-6728ef8d68c8 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Sep 26 05:22:29.093075 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 05:22:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:22:29.583231 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-5722dc50-3487-4e8e-96c9-5ac89b963a97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "name": "m1.large", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:29.589471 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG dbcounter [-] [105559] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:29.608650 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-5722dc50-3487-4e8e-96c9-5ac89b963a97 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.509098 Sep 26 05:22:29.609393 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 05:22:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:22:29.621287 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-f42cef8e-ee58-4b9f-baaf-7004a470dcde admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:29.645258 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-f42cef8e-ee58-4b9f-baaf-7004a470dcde admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027632 Sep 26 05:22:29.646166 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1333 bytes} [Mon Sep 26 05:22:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:22:32.406002 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-5722dc50-3487-4e8e-96c9-5ac89b963a97 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:32.406921 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-5722dc50-3487-4e8e-96c9-5ac89b963a97 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 26 05:22:32.407327 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 05:22:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:22:32.848748 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-d422dbd4-286d-4a27-a8fc-5acdb5ddbccb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0}} {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:32.857062 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG dbcounter [-] [105558] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:32.872735 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-d422dbd4-286d-4a27-a8fc-5acdb5ddbccb admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.459131 Sep 26 05:22:32.873611 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 05:22:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:22:32.886041 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-38653a6a-e307-4219-8a68-20c7759237d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:22:32.913849 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-38653a6a-e307-4219-8a68-20c7759237d9 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032237 Sep 26 05:22:32.914432 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1333 bytes} [Mon Sep 26 05:22:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:22:52.781193 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-d422dbd4-286d-4a27-a8fc-5acdb5ddbccb admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:52.782201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-d422dbd4-286d-4a27-a8fc-5acdb5ddbccb admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 26 05:22:52.782597 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 05:22:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:22:52.793127 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG dbcounter [-] [105559] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:53.174576 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-7bbffd16-c700-4187-9e4e-f2be6d3dac56 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:53.193011 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-7bbffd16-c700-4187-9e4e-f2be6d3dac56 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404573 Sep 26 05:22:53.193541 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1292 bytes} [Mon Sep 26 05:22:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:22:54.517156 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-d422dbd4-286d-4a27-a8fc-5acdb5ddbccb admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:54.518156 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-d422dbd4-286d-4a27-a8fc-5acdb5ddbccb admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Sep 26 05:22:54.518555 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 05:22:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:22:55.058505 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-127c28ff-5850-4397-93b7-b2db9ed12805 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:55.063792 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.wsgi [None req-127c28ff-5850-4397-93b7-b2db9ed12805 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-127c28ff-5850-4397-93b7-b2db9ed12805 admin admin] Request method failure captured: Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Accept: application/json Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Accept-Encoding: gzip, deflate Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Connection: keep-alive Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Content-Length: 0 Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Host: 10.222.0.49 Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Openstack-Api-Version: compute 2.92 Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Openstack-System-Scope: None Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: User-Agent: python-novaclient Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Auth-Token: gAAAAABjMTcu3C8ED2aahVwYNs81y2Y3oB2fEcMfZL_eDUAyonzaY-YNCTyAxlCzsDdqq80NSIcCoBZ0-r5bZT3prrk4iJNmAP5bfF5Uok4h-s3kT8Gn7wRPa-It-NRp2twcc2G_d-SLx_0i3nyU3zc1hjsKjlFd1UlqYUMjmCbouVpiueRokFk Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Domain-Id: None Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Domain-Name: None Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Identity-Status: Confirmed Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Is-Admin-Project: True Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Project-Domain-Id: default Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Project-Domain-Name: Default Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Project-Id: 3af173ac0b7d40069de1fa09770699a3 Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Project-Name: admin Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Role: reader,member,admin Sep 26 05:22:55.067029 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Roles: reader,member,admin Sep 26 05:22:55.068736 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3af173ac0b7d40069de1fa09770699a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3af173ac0b7d40069de1fa09770699a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3af173ac0b7d40069de1fa09770699a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3af173ac0b7d40069de1fa09770699a3"}]}] Sep 26 05:22:55.068736 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Tenant: admin Sep 26 05:22:55.068736 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Tenant-Id: 3af173ac0b7d40069de1fa09770699a3 Sep 26 05:22:55.068736 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Tenant-Name: admin Sep 26 05:22:55.068736 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-User: admin Sep 26 05:22:55.068736 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-User-Domain-Id: default Sep 26 05:22:55.068736 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-User-Domain-Name: Default Sep 26 05:22:55.068736 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-User-Id: 6c403c92b6314d26999d2aed9104bf3f Sep 26 05:22:55.068736 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-User-Name: admin Sep 26 05:22:55.068736 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: method: > Sep 26 05:22:55.068736 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: exception: Flavor 42 could not be found. Sep 26 05:22:55.068736 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: action_args: {'id': '42'} Sep 26 05:22:55.068736 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:22:55.068736 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:22:55.069796 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:22:55.071266 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:22:55.071266 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:22:55.071266 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:22:55.071266 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:22:55.071266 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 05:22:55.071266 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:22:55.071266 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 26 05:22:55.071266 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Sep 26 05:22:55.071266 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:22:55.071266 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Sep 26 05:22:55.071266 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:22:55.071266 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:22:55.071266 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:22:55.071266 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:22:55.071266 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:22:55.071266 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 26 05:22:55.071266 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Sep 26 05:22:55.071266 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-127c28ff-5850-4397-93b7-b2db9ed12805 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:22:55.072898 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-127c28ff-5850-4397-93b7-b2db9ed12805 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.396572 Sep 26 05:22:55.072898 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Sep 26 05:22:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:55.078513 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-f32d8d88-1e0f-426d-93b3-189d648c7ca9 admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:55.101820 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-f32d8d88-1e0f-426d-93b3-189d648c7ca9 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026801 Sep 26 05:22:55.102382 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Sep 26 05:22:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:22:55.114128 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-89161791-d5cc-4aab-ba2c-a29d5033f8b3 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:55.136621 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-89161791-d5cc-4aab-ba2c-a29d5033f8b3 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027230 Sep 26 05:22:55.137158 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Sep 26 05:22:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:22:55.146636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-8ca00b9a-a765-4ff6-a101-0ca52b2d78c2 admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:55.151923 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.wsgi [None req-8ca00b9a-a765-4ff6-a101-0ca52b2d78c2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-8ca00b9a-a765-4ff6-a101-0ca52b2d78c2 admin admin] Request method failure captured: Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Accept: application/json Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Accept-Encoding: gzip, deflate Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Connection: keep-alive Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Content-Length: 0 Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Host: 10.222.0.49 Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Openstack-Api-Version: compute 2.92 Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Openstack-System-Scope: None Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: User-Agent: python-novaclient Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Auth-Token: gAAAAABjMTcu3C8ED2aahVwYNs81y2Y3oB2fEcMfZL_eDUAyonzaY-YNCTyAxlCzsDdqq80NSIcCoBZ0-r5bZT3prrk4iJNmAP5bfF5Uok4h-s3kT8Gn7wRPa-It-NRp2twcc2G_d-SLx_0i3nyU3zc1hjsKjlFd1UlqYUMjmCbouVpiueRokFk Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Domain-Id: None Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Domain-Name: None Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Identity-Status: Confirmed Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Is-Admin-Project: True Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Project-Domain-Id: default Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Project-Domain-Name: Default Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Project-Id: 3af173ac0b7d40069de1fa09770699a3 Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Project-Name: admin Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Role: reader,member,admin Sep 26 05:22:55.155201 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Roles: reader,member,admin Sep 26 05:22:55.156753 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3af173ac0b7d40069de1fa09770699a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3af173ac0b7d40069de1fa09770699a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3af173ac0b7d40069de1fa09770699a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3af173ac0b7d40069de1fa09770699a3"}]}] Sep 26 05:22:55.156753 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Tenant: admin Sep 26 05:22:55.156753 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Tenant-Id: 3af173ac0b7d40069de1fa09770699a3 Sep 26 05:22:55.156753 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Tenant-Name: admin Sep 26 05:22:55.156753 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-User: admin Sep 26 05:22:55.156753 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-User-Domain-Id: default Sep 26 05:22:55.156753 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-User-Domain-Name: Default Sep 26 05:22:55.156753 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-User-Id: 6c403c92b6314d26999d2aed9104bf3f Sep 26 05:22:55.156753 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-User-Name: admin Sep 26 05:22:55.156753 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: method: > Sep 26 05:22:55.156753 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: exception: Flavor 42 could not be found. Sep 26 05:22:55.156753 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: action_args: {'id': '42'} Sep 26 05:22:55.156753 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:22:55.156753 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:22:55.157929 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:22:55.159235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:22:55.159235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:22:55.159235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:22:55.159235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:22:55.159235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 05:22:55.159235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:22:55.159235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 26 05:22:55.159235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Sep 26 05:22:55.159235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:22:55.159235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Sep 26 05:22:55.159235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:22:55.159235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:22:55.159235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:22:55.159235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:22:55.159235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:22:55.159235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 26 05:22:55.159235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Sep 26 05:22:55.159235 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-8ca00b9a-a765-4ff6-a101-0ca52b2d78c2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:22:55.160488 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-8ca00b9a-a765-4ff6-a101-0ca52b2d78c2 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013734 Sep 26 05:22:55.160488 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Sep 26 05:22:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:56.373214 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-89161791-d5cc-4aab-ba2c-a29d5033f8b3 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:56.374254 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-89161791-d5cc-4aab-ba2c-a29d5033f8b3 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 26 05:22:56.374656 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 05:22:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:22:56.894686 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-e2a1ec97-60d6-4ec0-8487-3cc12b04259c admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:56.899695 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.wsgi [None req-e2a1ec97-60d6-4ec0-8487-3cc12b04259c admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-e2a1ec97-60d6-4ec0-8487-3cc12b04259c admin admin] Request method failure captured: Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Accept: application/json Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Accept-Encoding: gzip, deflate Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Connection: keep-alive Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Content-Length: 0 Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Host: 10.222.0.49 Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Openstack-Api-Version: compute 2.92 Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Openstack-System-Scope: None Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: User-Agent: python-novaclient Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Auth-Token: gAAAAABjMTcwgXDg_W739_MPvGfajyE0dk_k1ivN9qsrGTsmhvkuchhH1vfBlibbbbHSPS4DbttOQg5wRUsrO_Z16aGFK1gjZ1hWRDr9hZ2Ox6CAlA6hIlZph-ymMMPUgfeQJCMdXjP7Tk5mFHcg-yAmaktJ2upWLrXqJdbHRGzupxR_CTrhGic Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Domain-Id: None Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Domain-Name: None Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Identity-Status: Confirmed Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Is-Admin-Project: True Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Project-Domain-Id: default Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Project-Domain-Name: Default Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Project-Id: 3af173ac0b7d40069de1fa09770699a3 Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Project-Name: admin Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Role: reader,member,admin Sep 26 05:22:56.901745 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Roles: reader,member,admin Sep 26 05:22:56.903325 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3af173ac0b7d40069de1fa09770699a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3af173ac0b7d40069de1fa09770699a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3af173ac0b7d40069de1fa09770699a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3af173ac0b7d40069de1fa09770699a3"}]}] Sep 26 05:22:56.903325 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Tenant: admin Sep 26 05:22:56.903325 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Tenant-Id: 3af173ac0b7d40069de1fa09770699a3 Sep 26 05:22:56.903325 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Tenant-Name: admin Sep 26 05:22:56.903325 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-User: admin Sep 26 05:22:56.903325 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-User-Domain-Id: default Sep 26 05:22:56.903325 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-User-Domain-Name: Default Sep 26 05:22:56.903325 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-User-Id: 6c403c92b6314d26999d2aed9104bf3f Sep 26 05:22:56.903325 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-User-Name: admin Sep 26 05:22:56.903325 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: method: > Sep 26 05:22:56.903325 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: exception: Flavor 84 could not be found. Sep 26 05:22:56.903325 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: action_args: {'id': '84'} Sep 26 05:22:56.903325 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:22:56.903325 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:22:56.904570 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:22:56.906099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:22:56.906099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:22:56.906099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:22:56.906099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:22:56.906099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 05:22:56.906099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:22:56.906099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 26 05:22:56.906099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Sep 26 05:22:56.906099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:22:56.906099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Sep 26 05:22:56.906099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:22:56.906099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:22:56.906099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:22:56.906099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:22:56.906099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:22:56.906099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 26 05:22:56.906099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Sep 26 05:22:56.906099 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-e2a1ec97-60d6-4ec0-8487-3cc12b04259c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:22:56.907378 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-e2a1ec97-60d6-4ec0-8487-3cc12b04259c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.391213 Sep 26 05:22:56.907378 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Sep 26 05:22:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:56.912906 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-b4446fbb-170a-4d58-ab14-bdb741deca00 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:56.928666 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-b4446fbb-170a-4d58-ab14-bdb741deca00 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019333 Sep 26 05:22:56.929201 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Sep 26 05:22:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:22:56.939514 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-60e45cd7-1b05-4140-96a2-16cd0a70071e admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:56.955480 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-60e45cd7-1b05-4140-96a2-16cd0a70071e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019492 Sep 26 05:22:56.956006 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Sep 26 05:22:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:22:56.965193 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-5b4b1d6e-8223-4999-a4ec-98b34ae1357e admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:56.970135 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.wsgi [None req-5b4b1d6e-8223-4999-a4ec-98b34ae1357e admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-5b4b1d6e-8223-4999-a4ec-98b34ae1357e admin admin] Request method failure captured: Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Accept: application/json Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Accept-Encoding: gzip, deflate Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Connection: keep-alive Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Content-Length: 0 Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Host: 10.222.0.49 Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Openstack-Api-Version: compute 2.92 Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Openstack-System-Scope: None Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: User-Agent: python-novaclient Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Auth-Token: gAAAAABjMTcwgXDg_W739_MPvGfajyE0dk_k1ivN9qsrGTsmhvkuchhH1vfBlibbbbHSPS4DbttOQg5wRUsrO_Z16aGFK1gjZ1hWRDr9hZ2Ox6CAlA6hIlZph-ymMMPUgfeQJCMdXjP7Tk5mFHcg-yAmaktJ2upWLrXqJdbHRGzupxR_CTrhGic Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Domain-Id: None Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Domain-Name: None Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Identity-Status: Confirmed Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Is-Admin-Project: True Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Project-Domain-Id: default Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Project-Domain-Name: Default Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Project-Id: 3af173ac0b7d40069de1fa09770699a3 Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Project-Name: admin Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Role: reader,member,admin Sep 26 05:22:56.971629 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Roles: reader,member,admin Sep 26 05:22:56.973278 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3af173ac0b7d40069de1fa09770699a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3af173ac0b7d40069de1fa09770699a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3af173ac0b7d40069de1fa09770699a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3af173ac0b7d40069de1fa09770699a3"}]}] Sep 26 05:22:56.973278 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Tenant: admin Sep 26 05:22:56.973278 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Tenant-Id: 3af173ac0b7d40069de1fa09770699a3 Sep 26 05:22:56.973278 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Tenant-Name: admin Sep 26 05:22:56.973278 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-User: admin Sep 26 05:22:56.973278 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-User-Domain-Id: default Sep 26 05:22:56.973278 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-User-Domain-Name: Default Sep 26 05:22:56.973278 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-User-Id: 6c403c92b6314d26999d2aed9104bf3f Sep 26 05:22:56.973278 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-User-Name: admin Sep 26 05:22:56.973278 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: method: > Sep 26 05:22:56.973278 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: exception: Flavor 84 could not be found. Sep 26 05:22:56.973278 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: action_args: {'id': '84'} Sep 26 05:22:56.973278 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:22:56.973278 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:22:56.974398 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:22:56.975783 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:22:56.975783 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:22:56.975783 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:22:56.975783 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:22:56.975783 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 05:22:56.975783 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:22:56.975783 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 26 05:22:56.975783 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Sep 26 05:22:56.975783 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:22:56.975783 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Sep 26 05:22:56.975783 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:22:56.975783 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:22:56.975783 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:22:56.975783 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:22:56.975783 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:22:56.975783 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 26 05:22:56.975783 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Sep 26 05:22:56.975783 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-5b4b1d6e-8223-4999-a4ec-98b34ae1357e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:22:56.977073 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-5b4b1d6e-8223-4999-a4ec-98b34ae1357e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011436 Sep 26 05:22:56.977073 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Sep 26 05:22:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:58.184274 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-60e45cd7-1b05-4140-96a2-16cd0a70071e admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:58.185268 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-60e45cd7-1b05-4140-96a2-16cd0a70071e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 26 05:22:58.185655 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 05:22:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:22:58.715099 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-38abe853-7dfd-43e1-bb5c-6300da17b800 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:58.721043 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.wsgi [None req-38abe853-7dfd-43e1-bb5c-6300da17b800 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-38abe853-7dfd-43e1-bb5c-6300da17b800 admin admin] Request method failure captured: Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Accept: application/json Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Accept-Encoding: gzip, deflate Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Connection: keep-alive Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Content-Length: 0 Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Host: 10.222.0.49 Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Openstack-Api-Version: compute 2.92 Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Openstack-System-Scope: None Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: User-Agent: python-novaclient Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Auth-Token: gAAAAABjMTcy4zut4kWzI1fZeezK-yW46Z5cj-uydkCGeVHMxUNV--5mOSSmr-p-PXSEn59_JKCsKTK9AFR_rI5sXnbgqhn31ZoUSnQ83GrHA2mS2cFoYS9d47wKSXug7OdZQT7HH0qhXhs8o8dLTXkSpCdn7m0imkpKrPalmHlNKceXM6Gtujs Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Domain-Id: None Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Domain-Name: None Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Identity-Status: Confirmed Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Is-Admin-Project: True Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Project-Domain-Id: default Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Project-Domain-Name: Default Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Project-Id: 3af173ac0b7d40069de1fa09770699a3 Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Project-Name: admin Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Role: reader,member,admin Sep 26 05:22:58.722543 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Roles: reader,member,admin Sep 26 05:22:58.724027 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3af173ac0b7d40069de1fa09770699a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3af173ac0b7d40069de1fa09770699a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3af173ac0b7d40069de1fa09770699a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3af173ac0b7d40069de1fa09770699a3"}]}] Sep 26 05:22:58.724027 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Tenant: admin Sep 26 05:22:58.724027 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Tenant-Id: 3af173ac0b7d40069de1fa09770699a3 Sep 26 05:22:58.724027 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-Tenant-Name: admin Sep 26 05:22:58.724027 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-User: admin Sep 26 05:22:58.724027 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-User-Domain-Id: default Sep 26 05:22:58.724027 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-User-Domain-Name: Default Sep 26 05:22:58.724027 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-User-Id: 6c403c92b6314d26999d2aed9104bf3f Sep 26 05:22:58.724027 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: X-User-Name: admin Sep 26 05:22:58.724027 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: method: > Sep 26 05:22:58.724027 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: exception: Flavor 451 could not be found. Sep 26 05:22:58.724027 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: action_args: {'id': '451'} Sep 26 05:22:58.724027 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:22:58.724027 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:22:58.724902 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:22:58.726154 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:22:58.726154 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:22:58.726154 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:22:58.726154 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:22:58.726154 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 05:22:58.726154 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:22:58.726154 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 26 05:22:58.726154 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Sep 26 05:22:58.726154 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:22:58.726154 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Sep 26 05:22:58.726154 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:22:58.726154 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:22:58.726154 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:22:58.726154 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:22:58.726154 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:22:58.726154 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 26 05:22:58.726154 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: ERROR nova.api.openstack.wsgi Sep 26 05:22:58.726154 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-38abe853-7dfd-43e1-bb5c-6300da17b800 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:22:58.727432 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-38abe853-7dfd-43e1-bb5c-6300da17b800 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.395838 Sep 26 05:22:58.727432 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Sep 26 05:22:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:58.734963 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-9b8674d4-bc3b-44fa-a349-d523a06ed95b admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:58.750255 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-9b8674d4-bc3b-44fa-a349-d523a06ed95b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019159 Sep 26 05:22:58.750774 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Sep 26 05:22:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:22:58.760071 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-f8599584-60c9-41f8-8a7e-6e3f3aba92c0 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:58.775798 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-f8599584-60c9-41f8-8a7e-6e3f3aba92c0 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019191 Sep 26 05:22:58.776344 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Sep 26 05:22:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:22:58.785557 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-5110123b-2644-4f4b-856b-2d3186e11758 admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:22:58.790931 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.wsgi [None req-5110123b-2644-4f4b-856b-2d3186e11758 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-5110123b-2644-4f4b-856b-2d3186e11758 admin admin] Request method failure captured: Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Accept: application/json Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Accept-Encoding: gzip, deflate Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Connection: keep-alive Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Content-Length: 0 Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Host: 10.222.0.49 Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Openstack-Api-Version: compute 2.92 Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Openstack-System-Scope: None Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: User-Agent: python-novaclient Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Auth-Token: gAAAAABjMTcy4zut4kWzI1fZeezK-yW46Z5cj-uydkCGeVHMxUNV--5mOSSmr-p-PXSEn59_JKCsKTK9AFR_rI5sXnbgqhn31ZoUSnQ83GrHA2mS2cFoYS9d47wKSXug7OdZQT7HH0qhXhs8o8dLTXkSpCdn7m0imkpKrPalmHlNKceXM6Gtujs Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Domain-Id: None Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Domain-Name: None Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Identity-Status: Confirmed Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Is-Admin-Project: True Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Project-Domain-Id: default Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Project-Domain-Name: Default Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Project-Id: 3af173ac0b7d40069de1fa09770699a3 Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Project-Name: admin Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Role: reader,member,admin Sep 26 05:22:58.792636 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Roles: reader,member,admin Sep 26 05:22:58.794215 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3af173ac0b7d40069de1fa09770699a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3af173ac0b7d40069de1fa09770699a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3af173ac0b7d40069de1fa09770699a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3af173ac0b7d40069de1fa09770699a3"}]}] Sep 26 05:22:58.794215 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Tenant: admin Sep 26 05:22:58.794215 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Tenant-Id: 3af173ac0b7d40069de1fa09770699a3 Sep 26 05:22:58.794215 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-Tenant-Name: admin Sep 26 05:22:58.794215 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-User: admin Sep 26 05:22:58.794215 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-User-Domain-Id: default Sep 26 05:22:58.794215 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-User-Domain-Name: Default Sep 26 05:22:58.794215 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-User-Id: 6c403c92b6314d26999d2aed9104bf3f Sep 26 05:22:58.794215 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: X-User-Name: admin Sep 26 05:22:58.794215 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: method: > Sep 26 05:22:58.794215 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: exception: Flavor 451 could not be found. Sep 26 05:22:58.794215 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: action_args: {'id': '451'} Sep 26 05:22:58.794215 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:22:58.794215 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:22:58.795339 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:22:58.796706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:22:58.796706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:22:58.796706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:22:58.796706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:22:58.796706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 05:22:58.796706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:22:58.796706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 26 05:22:58.796706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Sep 26 05:22:58.796706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:22:58.796706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Sep 26 05:22:58.796706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:22:58.796706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:22:58.796706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:22:58.796706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:22:58.796706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:22:58.796706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 26 05:22:58.796706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: ERROR nova.api.openstack.wsgi Sep 26 05:22:58.796706 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-5110123b-2644-4f4b-856b-2d3186e11758 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:22:58.797963 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-5110123b-2644-4f4b-856b-2d3186e11758 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011972 Sep 26 05:22:58.797963 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Sep 26 05:22:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 05:23:00.005342 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-f8599584-60c9-41f8-8a7e-6e3f3aba92c0 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:23:00.006354 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-f8599584-60c9-41f8-8a7e-6e3f3aba92c0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 26 05:23:00.006750 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 05:23:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:23:00.532013 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-8e80b7fd-06d6-48bb-965c-f07f95d067ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:23:00.550974 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-8e80b7fd-06d6-48bb-965c-f07f95d067ec admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.400808 Sep 26 05:23:00.551519 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Sep 26 05:23:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:23:01.778305 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-f8599584-60c9-41f8-8a7e-6e3f3aba92c0 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:23:01.779307 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-f8599584-60c9-41f8-8a7e-6e3f3aba92c0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Sep 26 05:23:01.779842 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 05:23:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:23:02.309509 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-c3eb5b88-7176-4f6d-b099-e23622f4b421 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:23:02.327581 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-c3eb5b88-7176-4f6d-b099-e23622f4b421 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.410595 Sep 26 05:23:02.328118 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Sep 26 05:23:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:23:03.534745 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-f8599584-60c9-41f8-8a7e-6e3f3aba92c0 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:23:03.535737 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-f8599584-60c9-41f8-8a7e-6e3f3aba92c0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Sep 26 05:23:03.536138 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 05:23:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:23:04.057373 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-bd61816f-38ff-4d54-ad52-293dc61fa9f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:23:04.076132 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-bd61816f-38ff-4d54-ad52-293dc61fa9f4 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.402011 Sep 26 05:23:04.076703 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Sep 26 05:23:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 05:23:05.319815 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-f8599584-60c9-41f8-8a7e-6e3f3aba92c0 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:23:05.320866 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-f8599584-60c9-41f8-8a7e-6e3f3aba92c0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 26 05:23:05.321256 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 05:23:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:23:05.846538 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-2bee62ae-7716-4902-87ac-0e74d9ca8bf4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:23:05.864725 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-2bee62ae-7716-4902-87ac-0e74d9ca8bf4 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.402820 Sep 26 05:23:05.865275 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Sep 26 05:23:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 05:23:07.092301 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-f8599584-60c9-41f8-8a7e-6e3f3aba92c0 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:23:07.093419 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-f8599584-60c9-41f8-8a7e-6e3f3aba92c0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Sep 26 05:23:07.093819 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 05:23:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:23:07.614252 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-0bff228c-977b-49bc-bae4-d475b393e8df admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:23:07.634815 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-0bff228c-977b-49bc-bae4-d475b393e8df admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.403967 Sep 26 05:23:07.635346 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Mon Sep 26 05:23:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:24:04.557163 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-f8599584-60c9-41f8-8a7e-6e3f3aba92c0 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:24:04.558003 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-f8599584-60c9-41f8-8a7e-6e3f3aba92c0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 Sep 26 05:24:04.558400 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 05:24:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:24:04.568978 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG dbcounter [-] [105558] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:24:04.945668 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-c40abc6c-c77d-424a-9a15-bfb1e82999fa admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:24:04.966144 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-c40abc6c-c77d-424a-9a15-bfb1e82999fa admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401678 Sep 26 05:24:04.966671 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1292 bytes} [Mon Sep 26 05:24:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:24:04.988306 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG dbcounter [-] [105559] Writing DB stats nova_api:SELECT=14 {{(pid=105559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:24:04.992309 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-8afbb643-c066-4914-8a1d-23651805e32b admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:24:04.999999 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-8afbb643-c066-4914-8a1d-23651805e32b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013187 Sep 26 05:24:05.000565 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1283 bytes} [Mon Sep 26 05:24:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:24:05.012017 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-0bb1ab55-28ec-429b-b1be-4bf57dc15d2f admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:24:05.019238 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-0bb1ab55-28ec-429b-b1be-4bf57dc15d2f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010825 Sep 26 05:24:05.019743 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1286 bytes} [Mon Sep 26 05:24:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:24:05.031339 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-3bdd7c4e-53dd-4d60-bead-bf0af83bf7c4 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:24:05.038455 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-3bdd7c4e-53dd-4d60-bead-bf0af83bf7c4 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010587 Sep 26 05:24:05.038966 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1286 bytes} [Mon Sep 26 05:24:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:24:05.050410 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-58e64154-80da-4dde-850f-ad451a830521 admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:24:05.057338 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-58e64154-80da-4dde-850f-ad451a830521 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010325 Sep 26 05:24:05.057841 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1283 bytes} [Mon Sep 26 05:24:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:27:08.638611 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-3bdd7c4e-53dd-4d60-bead-bf0af83bf7c4 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:27:08.639673 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-3bdd7c4e-53dd-4d60-bead-bf0af83bf7c4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 26 05:27:08.640072 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 05:27:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:27:08.779147 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG dbcounter [-] [105558] Writing DB stats nova_api:SELECT=6 {{(pid=105558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:27:08.938538 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-9bf84f4a-8980-4037-8816-6867bff31b4f admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:27:08.943146 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-9bf84f4a-8980-4037-8816-6867bff31b4f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:27:08.943657 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-9bf84f4a-8980-4037-8816-6867bff31b4f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:27:08.944356 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-9bf84f4a-8980-4037-8816-6867bff31b4f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:27:08.945071 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-9bf84f4a-8980-4037-8816-6867bff31b4f admin admin] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:27:08.945515 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-9bf84f4a-8980-4037-8816-6867bff31b4f admin admin] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:27:08.945927 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-9bf84f4a-8980-4037-8816-6867bff31b4f admin admin] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:27:08.978223 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-9bf84f4a-8980-4037-8816-6867bff31b4f admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.200212 Sep 26 05:27:08.978774 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Sep 26 05:27:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:27:10.052697 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-3bdd7c4e-53dd-4d60-bead-bf0af83bf7c4 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:27:10.053942 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-3bdd7c4e-53dd-4d60-bead-bf0af83bf7c4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001707 Sep 26 05:27:10.054351 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 05:27:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:27:10.245679 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-ef700291-8db9-444d-9cb1-4f83d3c7f9be admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:27:10.249048 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-ef700291-8db9-444d-9cb1-4f83d3c7f9be admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:27:10.249515 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-ef700291-8db9-444d-9cb1-4f83d3c7f9be admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:27:10.249935 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-ef700291-8db9-444d-9cb1-4f83d3c7f9be admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:27:10.250637 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-ef700291-8db9-444d-9cb1-4f83d3c7f9be admin admin] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:27:10.251083 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-ef700291-8db9-444d-9cb1-4f83d3c7f9be admin admin] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:27:10.251493 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-ef700291-8db9-444d-9cb1-4f83d3c7f9be admin admin] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:27:10.270844 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-ef700291-8db9-444d-9cb1-4f83d3c7f9be admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076105 Sep 26 05:27:10.271318 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Sep 26 05:27:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:27:21.769016 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-3bdd7c4e-53dd-4d60-bead-bf0af83bf7c4 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:27:21.770015 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-3bdd7c4e-53dd-4d60-bead-bf0af83bf7c4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 26 05:27:21.770413 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 05:27:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:27:21.914701 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG dbcounter [-] [105558] Writing DB stats nova_cell0:SELECT=4 {{(pid=105558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:27:21.915420 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG dbcounter [-] [105558] Writing DB stats nova_cell1:SELECT=4 {{(pid=105558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:27:21.916034 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG dbcounter [-] [105558] Writing DB stats nova_api:SELECT=8 {{(pid=105558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:27:21.964585 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-7f02ca6c-4aeb-4ea7-b5e8-35af1a7a5e62 admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:27:21.967964 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-7f02ca6c-4aeb-4ea7-b5e8-35af1a7a5e62 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:27:21.968693 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-7f02ca6c-4aeb-4ea7-b5e8-35af1a7a5e62 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:27:21.969130 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-7f02ca6c-4aeb-4ea7-b5e8-35af1a7a5e62 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:27:21.969845 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-7f02ca6c-4aeb-4ea7-b5e8-35af1a7a5e62 admin admin] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:27:21.970323 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-7f02ca6c-4aeb-4ea7-b5e8-35af1a7a5e62 admin admin] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:27:21.970955 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-7f02ca6c-4aeb-4ea7-b5e8-35af1a7a5e62 admin admin] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:27:21.995941 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-7f02ca6c-4aeb-4ea7-b5e8-35af1a7a5e62 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.085757 Sep 26 05:27:21.996459 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 38/74] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Sep 26 05:27:21 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:27:23.107972 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG nova.api.openstack.wsgi [None req-3bdd7c4e-53dd-4d60-bead-bf0af83bf7c4 admin admin] Calling method '>' {{(pid=105559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:27:23.109113 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: INFO nova.api.openstack.requestlog [None req-3bdd7c4e-53dd-4d60-bead-bf0af83bf7c4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Sep 26 05:27:23.109521 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: [pid: 105559|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 05:27:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:27:23.301774 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG nova.api.openstack.wsgi [None req-f97ee8e1-6033-4ce0-8f9d-51d9b99b99fa admin admin] Calling method '>' {{(pid=105558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:27:23.305617 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-f97ee8e1-6033-4ce0-8f9d-51d9b99b99fa admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:27:23.306090 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-f97ee8e1-6033-4ce0-8f9d-51d9b99b99fa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:27:23.306517 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-f97ee8e1-6033-4ce0-8f9d-51d9b99b99fa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:27:23.307226 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-f97ee8e1-6033-4ce0-8f9d-51d9b99b99fa admin admin] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:27:23.307672 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-f97ee8e1-6033-4ce0-8f9d-51d9b99b99fa admin admin] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:27:23.308088 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: DEBUG oslo_concurrency.lockutils [None req-f97ee8e1-6033-4ce0-8f9d-51d9b99b99fa admin admin] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:27:23.329882 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: INFO nova.api.openstack.requestlog [None req-f97ee8e1-6033-4ce0-8f9d-51d9b99b99fa admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.080734 Sep 26 05:27:23.330442 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: [pid: 105558|app: 0|req: 39/76] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Sep 26 05:27:23 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:28:22.125815 dv-cinder-859186-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 26 05:28:22.126488 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: Mon Sep 26 05:28:22 2022 - graceful shutdown triggered... Sep 26 05:28:22.126937 dv-cinder-859186-2-iscsi devstack@n-api.service[105558]: Gracefully killing worker 1 (pid: 105558)... Sep 26 05:28:22.127758 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: Gracefully killing worker 2 (pid: 105559)... Sep 26 05:28:22.253081 dv-cinder-859186-2-iscsi devstack@n-api.service[105559]: DEBUG dbcounter [-] [105559] Writing DB stats nova_api:SELECT=4 {{(pid=105559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:28:23.127269 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: worker 1 buried after 1 seconds Sep 26 05:28:23.127269 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: worker 2 buried after 1 seconds Sep 26 05:28:23.127269 dv-cinder-859186-2-iscsi devstack@n-api.service[105557]: goodbye to uWSGI. Sep 26 05:28:23.128875 dv-cinder-859186-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 26 05:28:23.129425 dv-cinder-859186-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 26 05:28:23.132161 dv-cinder-859186-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 26 05:28:23.148470 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 26 05:28:23.151647 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 26 05:28:23 2022] *** Sep 26 05:28:23.151647 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 26 05:28:23.151647 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 26 05:28:23.151647 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: nodename: dv-cinder-859186-2-iscsi Sep 26 05:28:23.151647 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: machine: x86_64 Sep 26 05:28:23.151647 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: clock source: unix Sep 26 05:28:23.151647 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: pcre jit disabled Sep 26 05:28:23.151647 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: detected number of CPU cores: 4 Sep 26 05:28:23.151647 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: current working directory: / Sep 26 05:28:23.151647 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: detected binary path: /usr/bin/uwsgi-core Sep 26 05:28:23.151647 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: your processes number limit is 47680 Sep 26 05:28:23.152580 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: your memory page size is 4096 bytes Sep 26 05:28:23.152580 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: detected max file descriptor number: 2048 Sep 26 05:28:23.152580 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: lock engine: pthread robust mutexes Sep 26 05:28:23.152580 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: thunder lock: enabled Sep 26 05:28:23.152580 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 26 05:28:23.152580 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 26 05:28:23.192454 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: Python main interpreter initialized at 0x55befdb8f9c0 Sep 26 05:28:23.192454 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: python threads support enabled Sep 26 05:28:23.192454 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: your server socket listen backlog is limited to 100 connections Sep 26 05:28:23.192454 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: your mercy for graceful operations on workers is 90 seconds Sep 26 05:28:23.192924 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: mapped 403077 bytes (393 KB) for 2 cores Sep 26 05:28:23.192924 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: *** Operational MODE: preforking *** Sep 26 05:28:23.193150 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: *** uWSGI is running in multiple interpreter mode *** Sep 26 05:28:23.193150 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: spawned uWSGI master process (pid: 120793) Sep 26 05:28:23.193357 dv-cinder-859186-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 26 05:28:23.194463 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: spawned uWSGI worker 1 (pid: 120805, cores: 1) Sep 26 05:28:23.194463 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: spawned uWSGI worker 2 (pid: 120806, cores: 1) Sep 26 05:28:23.194463 dv-cinder-859186-2-iscsi devstack@n-api.service[120793]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 26 05:28:23.865241 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 05:28:23.877848 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 05:28:25.031149 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:28:25.031149 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: from cryptography.utils import int_from_bytes Sep 26 05:28:25.032186 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:28:25.032186 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: from cryptography.utils import int_from_bytes Sep 26 05:28:25.045675 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:28:25.045675 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: from cryptography.utils import int_from_bytes Sep 26 05:28:25.046201 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:28:25.046201 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: from cryptography.utils import int_from_bytes Sep 26 05:28:27.494629 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 05:28:27.495267 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 05:28:27.495562 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 05:28:27.495828 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 05:28:27.496095 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 05:28:27.496521 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.496860 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.497195 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.497525 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.497864 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.498183 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.498514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.498843 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.499179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.499445 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.499770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.500279 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859186-2-iscsi {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.500616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.500952 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.501259 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.501588 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.501902 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.502249 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.502573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.503127 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.504775 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.505060 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.505390 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.505748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.506097 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.506427 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.506769 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.507091 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.507427 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.507750 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.508168 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859186-2-iscsi {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.508531 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.508643 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 05:28:27.509020 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 05:28:27.509105 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.509432 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 05:28:27.509556 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.509803 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 05:28:27.510067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 05:28:27.510186 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.510475 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.510604 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.510777 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.510902 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.511108 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.511225 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.511427 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.511539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.511753 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.511870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.512086 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.512193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.512402 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.512606 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.512766 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.512947 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.513114 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.513265 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.513419 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.513649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.513822 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.514015 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.514015 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.514300 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859186-2-iscsi {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.514456 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.514600 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.514749 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.514899 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.515112 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.515282 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.515425 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.515575 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.515717 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.515859 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.516019 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.516184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.516367 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.516539 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.516690 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.516690 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.516996 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.517193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.517352 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.517522 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.517691 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.517838 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.517992 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.518152 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.518306 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.518456 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.518650 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.518808 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.518976 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.519127 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.519270 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.519422 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.519565 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.519706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.519860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.520012 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.520181 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.520358 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.520531 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859186-2-iscsi {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.520693 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.520860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.521004 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.521154 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.522187 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.522356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.522509 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.522653 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.522804 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.522947 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.523096 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.523250 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.523399 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.523548 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.523708 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.523857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.524007 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.524163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.524350 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.525024 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.525177 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.525327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.525483 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.525634 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.525777 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.525918 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.526066 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.526226 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.526426 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.526574 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.526574 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.526841 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.526982 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.527130 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.527285 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.527429 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.527581 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.527731 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.527880 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.528037 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.528188 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.528352 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.528506 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.528703 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.528857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.529009 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.529159 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.529314 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.529457 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.529607 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.529756 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.529918 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.530067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.530209 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.530361 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.530505 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.530667 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.530819 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.530960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.531108 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.531257 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.531409 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.531560 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.531723 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.532508 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.532675 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.532830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.532991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.533146 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.533296 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.533446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.533596 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.533739 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.533888 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.534039 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.534183 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.534392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.534541 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.534690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.534852 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.534995 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.535143 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.535291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.535446 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.535736 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.535885 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.536034 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.536184 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.536482 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.536639 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.536782 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.536924 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.537078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.537220 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.537371 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.537512 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.537653 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.537804 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.537947 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.538100 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.538258 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.538400 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.538551 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.538741 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.538892 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.539035 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.539186 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.539344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.539493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.539493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.539769 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.539924 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.540806 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.541030 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.541182 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.541345 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.541489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.541645 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.541788 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.541937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.542751 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.542900 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.543042 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.543196 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.543350 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.543504 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.543653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.543803 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.543803 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.544094 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.544238 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.544428 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.544581 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.544730 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.544886 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.545028 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.545179 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.545331 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.545473 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.545625 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.545877 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.546027 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.555183 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.555442 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.555601 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.555760 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.555940 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.555940 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.556224 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.556509 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.556656 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.556817 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.556962 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.557126 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.557277 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.557436 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.557585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.557736 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.557881 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.558023 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.558174 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.562295 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.562473 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.562644 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.562850 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.563031 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.563215 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.563373 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.563525 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.563678 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.563827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.563990 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.564148 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.564340 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.564340 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.564626 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.564776 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.564919 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.565081 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.565234 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.565416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.565565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.565715 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.565868 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.566024 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.566169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.566318 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.566516 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.566671 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.566828 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.566971 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.567132 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.567287 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.567436 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.567579 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.567730 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.567880 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.567880 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.568156 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.568317 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.568491 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.568644 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.568793 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.568982 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.569150 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.569309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.569462 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.569613 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:27.569773 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.569923 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.570075 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.570218 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.570373 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.570515 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.570670 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.570830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.570998 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.571140 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.571291 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.571444 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.571595 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.571737 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.571737 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.572020 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.572163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.572163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.572497 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.572640 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.572781 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.572939 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.573090 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.573240 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.573390 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.577797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.577997 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.578154 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.578315 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.578483 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.578640 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.578787 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.578930 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.579079 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.579245 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.579389 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.579531 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.579672 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.579816 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.579957 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.580114 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.580308 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.580467 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.580620 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.580781 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.580926 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.581154 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.581322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.581467 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.581617 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.581761 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.581913 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.582066 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.582216 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.582412 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.582561 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.582730 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.582891 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.583037 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.583198 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.583341 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.583491 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.583633 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.583789 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.583933 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.584084 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.584232 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.584400 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.584543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.584737 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.584915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.585112 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.585294 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.585439 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.585590 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.585742 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.585893 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.586044 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.586189 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.586330 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.586480 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.586622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.586764 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.587451 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.591269 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.591485 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.591652 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.591802 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.591949 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.592102 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.592266 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.592463 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.592626 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.592770 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.592912 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.593062 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.595794 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.595975 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.596160 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.596376 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.596532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.596687 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.596832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.596991 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.597143 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.597294 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.597437 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.597594 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.597746 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.597934 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.598137 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.598322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.598322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.598616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.598766 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.598766 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.599054 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.599196 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.599347 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.599496 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.599638 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.599810 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.599965 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.600119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.600292 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.600452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.600604 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.600767 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.600919 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.601069 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.601211 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.601353 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.601509 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.601653 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.601796 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.604227 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.604377 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.604472 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.604572 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.604660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.604757 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.604844 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.604929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.605023 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.605118 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.605205 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.605298 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.605384 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.605469 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.605561 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.605670 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.605758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.605851 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.605943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.606029 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.606123 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.606210 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.606294 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.606390 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.606477 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.606571 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.606668 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.606762 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.606847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.606931 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.607059 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.607217 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.607388 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.607543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.607691 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.607842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.608020 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.608162 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.608351 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.608491 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.608637 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.608776 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.608924 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.609089 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.609235 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.609375 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.609524 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.609669 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.609798 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.609951 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.610103 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.610239 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.610372 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.610372 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.610616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.610757 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.610898 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.611043 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.611182 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.611576 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.611714 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.611856 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.611995 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.612142 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.612303 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.612457 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.612608 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.612753 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.612886 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.613018 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.613161 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.613298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.613450 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.613590 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.613723 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.613723 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.613964 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.613964 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.614224 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.614224 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.614475 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.614615 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.614748 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.614875 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.615024 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.615024 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.615275 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.615405 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.615546 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.615692 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.615823 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.615955 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.616095 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.616223 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.616399 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.616621 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.616750 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.616878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.616997 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.617124 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.617248 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.617383 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.617501 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.617634 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.617753 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.617879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.618004 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.618168 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.618291 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.618404 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.618521 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.618637 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.618754 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.618883 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.619047 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.619182 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.619308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.619434 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.619569 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.619686 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.619801 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.619914 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.620040 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.620160 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.620315 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.620437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.620555 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.620691 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.620809 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.620926 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.621059 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.621177 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.621295 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.621414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.621529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.621656 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.621792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.621918 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.622045 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.622162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.622278 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.622406 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.622531 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.622647 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.622759 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.622875 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.622991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.623121 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.623255 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.623359 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.623480 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.623606 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.623721 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.623849 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.623967 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.624081 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.624199 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.624371 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.624511 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.624644 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.624761 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.624874 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.624992 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.625109 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.625236 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.625351 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.625464 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.625588 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.625588 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.625812 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.625961 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.626088 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.626088 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.626088 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.626088 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.626595 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.626738 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.626868 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.627010 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.627150 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.627281 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.627423 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.627573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.627704 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.627834 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.627977 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.628113 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.628523 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.628670 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.628806 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.628939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.629068 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.629188 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.629328 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.629457 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.629574 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.629698 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.629822 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.629952 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.630080 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.630198 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.630314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.630430 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.630555 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.630673 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.630805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.630805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.631019 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.631133 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.631371 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.631512 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.631643 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.631770 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.631903 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.632018 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.632144 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.632293 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.632435 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.632555 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.632672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.632806 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.632933 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.633058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.633058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.633293 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.633293 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.633528 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.633647 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.633788 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.633910 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.634036 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.634167 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.634285 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.634403 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.634531 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.634657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.634787 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.634917 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.635044 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.635162 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.635276 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.635394 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.635509 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.635729 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.635858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.635977 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.636102 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.636228 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.636434 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.636562 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.636681 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.636803 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.636929 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.637057 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.637185 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.637185 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.637423 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.637555 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.637673 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.637795 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.637927 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.638045 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.638168 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.638299 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.638429 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.638544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.638671 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.638671 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.638888 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.639016 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.639156 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.639284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.639413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.639413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.639646 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.639779 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.639897 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.640022 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.640140 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.640277 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.640397 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.640540 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.640666 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.640779 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.640910 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.641036 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.641165 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.641279 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.641364 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.641438 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.641508 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.641593 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.641675 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.641754 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.641826 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.641897 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.641967 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.642037 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.642120 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.642192 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.642262 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.642331 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.642408 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.642480 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.642480 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.642629 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.642711 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.642783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.642855 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.642939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.643019 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.643098 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.643177 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.643249 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.643345 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.643459 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.643534 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.643605 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.643676 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.643753 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.643826 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.643905 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.643977 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.644048 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.644127 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.644200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.644338 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.644429 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.644511 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.644584 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.644662 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.644734 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.644813 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.644885 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.644962 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.645042 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.645114 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.645184 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.645275 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.645391 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.645507 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.645619 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.645739 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.645852 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.645976 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.646090 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.646200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.646322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.646443 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.646563 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.646689 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.646803 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.646933 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.647055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.647176 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.647301 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.647412 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.647412 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.647621 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.647734 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.647843 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.647963 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.648087 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.648200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.648348 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.648468 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.648579 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.648700 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.648822 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.648945 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.649056 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.649184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.649317 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.649988 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.650128 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.650255 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.650391 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.650534 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.650681 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.650818 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.650946 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.651082 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.651221 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.651364 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.651502 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.651641 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.651777 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.651915 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.651915 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.652163 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.652372 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.652512 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.652512 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.652761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.652888 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.653022 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.653022 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.653236 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.653316 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.653389 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.653466 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.653550 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.653629 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.653701 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.653771 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.653848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.653920 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.653999 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.654077 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.654149 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.654226 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.654297 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.654367 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.654445 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.654518 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.654587 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.654668 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.654740 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.654819 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.655036 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.655149 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.655224 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.655305 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.655378 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.655461 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.655541 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.655612 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.655683 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.655759 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.655831 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.655913 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.655985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.656062 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.656133 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.656203 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.656303 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.656389 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.656389 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.656527 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.656605 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.656684 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.656684 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.656832 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.656912 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.656997 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.657127 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.657251 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.657383 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.657497 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.657630 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.657745 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.657868 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.657982 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.657982 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.658198 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.658312 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.658423 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.658546 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.658658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.658786 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.658900 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.659011 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.659129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.659249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.659361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.659488 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.659614 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.659728 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.659838 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.659956 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.660088 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.660201 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.660201 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.660425 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.660554 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.660667 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.660788 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.660903 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.661022 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.661133 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.661252 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.661362 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.661362 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.661576 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.661716 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.661837 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.661957 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.662069 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.662189 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.662309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.662442 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.662568 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.662689 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.662817 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.662940 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.663052 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.663177 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.663290 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.663410 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.663546 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.663684 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.663809 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.663933 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.664057 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.664057 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.664411 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.664496 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.664577 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.664649 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.664728 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.664800 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.664881 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.664954 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.665085 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.665675 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.665759 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.665919 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.666028 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.666103 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.666174 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.666244 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.666362 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.666491 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.666593 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.666674 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.666746 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.666830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.666945 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.667030 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.667109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.667188 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.667270 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.667358 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.667440 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.667541 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.667642 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.667729 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.667814 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.667894 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.667894 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.668034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.668105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.668175 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.668260 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.668337 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.668337 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.668487 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.668487 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.668622 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.668700 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.668780 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.668864 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.668983 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.669100 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.669221 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.669333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.669444 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.669578 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.669694 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.669804 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.669917 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.670040 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.670172 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.670288 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.670417 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.670540 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.670653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.670779 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.670920 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.671050 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.671178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.671314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.671441 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.671580 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.671727 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.671857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.671857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.672078 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.672078 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.673104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.673267 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.673401 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.673401 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.673651 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.673826 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.673826 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.673826 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.673826 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.673826 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.674352 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.674352 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.674628 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.674948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.675061 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.675268 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.675575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.675685 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.675903 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.676124 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.676222 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.676580 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.676689 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.676910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.677008 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.677250 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.677354 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.677607 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.677713 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.677933 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.678026 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.678269 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.678367 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.678603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.678711 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.678919 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.679028 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.679231 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.679329 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.679547 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.679654 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.679859 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.679957 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.680174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.680307 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.680533 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.680839 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.680996 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.681179 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.681352 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.681496 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.681794 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.681927 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.682576 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.682676 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.682750 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.682750 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.682896 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.683021 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.683345 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.683455 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.683665 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.683844 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.683983 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.684346 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.684456 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.685022 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.685137 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.685231 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.685307 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.685377 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.685597 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.685848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.685950 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.686209 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.686325 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.686556 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.686857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.686964 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.687183 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.687424 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.687523 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.687835 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.687970 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.688153 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.688515 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.688626 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.688850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.689020 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.689179 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.689409 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.689521 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.689754 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.689852 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.690081 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.690179 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.690414 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.690569 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.690773 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.690875 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.691061 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.691163 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.691335 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.691442 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.691640 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.691745 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.691950 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.692048 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.692795 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.693412 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.693504 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.693588 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.693661 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.693732 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.693803 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.693873 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.693951 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.694036 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.694116 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.694194 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.694266 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.694343 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.694428 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.694508 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.695241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.695340 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.695414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.695485 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.695566 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.695639 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.695718 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.695798 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.695970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.696110 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.696691 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.696807 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.697066 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.697302 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.697378 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.697459 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.697714 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.697809 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.697903 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.697989 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.698346 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.698457 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.698534 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.698604 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.698858 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.698959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.699167 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.699279 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.699501 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.699600 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.699827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.699932 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.700151 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.700347 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.700542 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.700691 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.700884 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.700980 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.701156 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.701396 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.701495 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.701732 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.702018 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.702124 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.702359 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.703376 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.703468 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.703542 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.703613 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.703684 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.703769 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.703867 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.703949 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.704029 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.704101 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.704172 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.704274 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.704366 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.705019 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.705129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.705129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.705271 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.705345 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.705423 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.705503 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.705575 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.706108 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.706236 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.706236 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.706379 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.706451 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.706606 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.706759 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.706938 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.707080 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.707267 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.707683 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.707804 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.707974 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.708092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.708461 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.708549 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.708636 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.708742 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.708840 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.708927 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.709012 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.709230 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.709333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.709558 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.709662 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.709883 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.709976 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.710204 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.710300 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.710523 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.710618 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.710839 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.710932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.711175 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.711278 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.711476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.711569 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.711792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.712464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.712836 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.712967 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.713242 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.713506 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.713598 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.713683 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.713776 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.713875 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.713995 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.714172 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.714320 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.714646 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.714746 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.714974 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.715069 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.715355 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.715517 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.715686 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.715862 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.716016 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.716173 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.716436 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.716559 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.716762 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.716879 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.717098 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.717199 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.717411 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.717513 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.717721 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.717847 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.718037 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.718145 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.718351 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.718449 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.718659 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.718771 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.718988 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.719091 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.719303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.719401 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.719614 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.719719 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.719936 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.720034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.720336 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.720449 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.720611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.720806 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.720914 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.721164 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.721455 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.721554 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.721805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.721909 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.722135 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.722231 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.722458 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.722562 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.722773 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.722870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.723102 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.723200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.723471 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.723661 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.723803 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.723942 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.724101 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.724263 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.724370 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.724465 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.724658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.724753 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.724971 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.725065 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.725294 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.725396 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.725606 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.725706 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.725914 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.726013 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.726230 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.726350 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.726542 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.726640 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.726863 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.726971 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.727173 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.727274 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.727502 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.728339 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.728467 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.728578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.728761 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.729546 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.729660 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.729745 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.729819 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.729891 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.729976 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.730051 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.730122 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.730192 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.730263 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.730340 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.730547 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.730632 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.730867 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.731003 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.731177 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.731314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.731596 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.731678 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.731911 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.732001 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.732228 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.732455 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.732786 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.733063 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.733359 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.733528 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.733705 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.733819 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.734000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.734300 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.734396 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.734634 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.734725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.734952 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.735047 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.735270 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.735361 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.735606 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.735709 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.735926 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.736019 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.736520 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.736849 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.737194 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.737523 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.737814 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.737925 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.738147 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.738279 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.738512 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.738616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.738902 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.739016 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.739137 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.739383 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.739478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.739731 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.739826 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.740071 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.740179 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.740410 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.740517 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.740726 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.740828 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.741042 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.741138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.741358 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.741460 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.741672 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.741765 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.741985 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.742078 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.742299 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.742408 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.742612 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.742705 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.742923 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.743015 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.743278 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.743532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.743633 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.743715 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.743903 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.744132 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.744235 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.744485 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.744591 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.744871 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.744971 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.745158 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.745266 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.745474 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.745576 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.745792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.745893 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.746112 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.746214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.746425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.746524 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.746740 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.746832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.747056 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.747159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.747370 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.747464 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.747691 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.747785 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.748026 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.748126 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.748379 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.748519 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.748700 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.748811 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.749019 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.749207 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.749336 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.749525 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.749652 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.749848 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.749981 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.750174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.750319 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.750489 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.750640 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.750817 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.750953 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.751144 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.751387 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.751481 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.751711 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.751807 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.752037 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.752139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.752390 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.752501 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.752710 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.752813 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.753038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.753133 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.753365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.753602 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.753710 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.753795 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.753971 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.754075 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.754280 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.754381 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.754599 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.754724 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.754923 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.755031 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.755241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.755360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.755548 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.755642 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.755856 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.755950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.756168 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.756341 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.756499 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.756595 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.756809 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.756902 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.757116 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.757223 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.757422 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.757515 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.757733 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.757832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.758038 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.758327 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.758428 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.758636 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.759273 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.759487 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.759607 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.759799 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.759912 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.760104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.760207 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.760441 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.760547 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.760748 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.760840 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.761055 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.761145 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.761361 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.761464 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.761669 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.761760 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.761971 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.762068 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.762279 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.762378 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.762590 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.762697 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.762907 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.763012 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.763217 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.763312 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.763530 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.763648 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.763841 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.763954 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.764149 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.764243 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.764480 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.764579 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.764808 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.764924 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.765127 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.765221 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.765439 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.765539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.765776 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.765914 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.766090 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.766188 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.766408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.766502 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.766721 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.766823 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.767035 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.767134 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.767350 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.767451 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.767664 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.767769 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.767976 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.768067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.768336 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.768434 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.768649 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.768757 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.768965 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.769105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.769284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.769419 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.769605 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.769754 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.769922 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.770070 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.770237 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.770385 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.770580 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.770716 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.770914 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.771022 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.771228 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.771321 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.771560 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.771661 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.771885 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.771977 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.772212 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.772338 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.772557 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.772657 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.772870 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.772968 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.773186 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.773288 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.773505 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.773605 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.773817 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.773930 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.774132 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.774238 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.775181 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.775322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.775413 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.775582 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.775899 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.775994 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.776223 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.776353 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.776566 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.776660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.776893 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.776988 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.777217 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.777310 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.777551 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.777650 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.777871 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.777963 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.778188 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.778280 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.778496 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.778668 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.778763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120806) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 05:28:27.778849 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.779180 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.779500 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.779852 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.780186 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.780529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.780853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.781164 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:27.781414 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 05:28:27.842633 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO dbcounter [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] Registered counter for database nova_api Sep 26 05:28:27.845564 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO dbcounter [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] Registered counter for database nova_api Sep 26 05:28:27.864391 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_db.sqlalchemy.engines [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120806) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:28:27.866096 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_db.sqlalchemy.engines [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120805) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:28:27.871717 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writer thread running {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:28:27.872796 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writer thread running {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:28:27.927637 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.context [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f676b63-1e10-465f-9e48-7eb519e23a3a(cell1) {{(pid=120806) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 05:28:27.929965 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.context [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f676b63-1e10-465f-9e48-7eb519e23a3a(cell1) {{(pid=120805) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 05:28:27.931841 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:28:27.932347 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:28:27.933901 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:28:27.934049 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:28:27.934525 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:28:27.934622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:28:27.935060 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:28:27.936075 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:28:27.936832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:28:27.937099 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:28:27.937279 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:28:27.939080 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO dbcounter [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] Registered counter for database nova_cell0 Sep 26 05:28:27.939280 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:28:27.941369 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO dbcounter [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] Registered counter for database nova_cell0 Sep 26 05:28:27.943118 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO dbcounter [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] Registered counter for database nova_cell1 Sep 26 05:28:27.945485 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO dbcounter [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] Registered counter for database nova_cell1 Sep 26 05:28:27.951114 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_db.sqlalchemy.engines [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120806) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:28:27.953672 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_db.sqlalchemy.engines [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120806) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:28:27.955137 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_db.sqlalchemy.engines [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120805) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:28:27.957631 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_db.sqlalchemy.engines [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120805) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:28:27.964704 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writer thread running {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:28:27.965043 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writer thread running {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:28:27.966359 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writer thread running {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:28:27.974041 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writer thread running {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:28:28.124878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO dbcounter [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] Registered counter for database nova_cell0 Sep 26 05:28:28.131456 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_db.sqlalchemy.engines [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120806) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:28:28.136521 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writer thread running {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:28:28.153323 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO dbcounter [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] Registered counter for database nova_cell0 Sep 26 05:28:28.160132 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_db.sqlalchemy.engines [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120805) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:28:28.164604 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writer thread running {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:28:28.484223 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: WARNING keystonemiddleware.auth_token [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 05:28:28.491918 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: WARNING keystonemiddleware.auth_token [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 05:28:28.501849 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: WARNING keystonemiddleware.auth_token [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 05:28:28.509635 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: WARNING keystonemiddleware.auth_token [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 05:28:28.866767 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: WARNING keystonemiddleware.auth_token [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 05:28:28.867842 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: WARNING keystonemiddleware.auth_token [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 05:28:28.876271 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: WARNING keystonemiddleware.auth_token [None req-6cddbf95-2d78-4de8-9ef9-134bd49df788 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 05:28:28.876436 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: WARNING keystonemiddleware.auth_token [None req-dab19605-64f2-439a-9efd-b600b5746a7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 05:28:28.879626 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55befdb8f9c0 pid: 120805 (default app) Sep 26 05:28:28.880225 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55befdb8f9c0 pid: 120806 (default app) Sep 26 05:29:05.525996 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:05.527669 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:05.528789 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:05.529590 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:06.905104 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-271e7adf-1871-436b-8f70-d2f75a6b6532 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Action: 'create', calling method: .version_select at 0x7fd7b82c44c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-301937547"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:29:08.588946 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-271e7adf-1871-436b-8f70-d2f75a6b6532 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.073687 Sep 26 05:29:08.596306 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1155 bytes} [Mon Sep 26 05:29:05 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3077 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 26 05:29:08.634979 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=3 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:08.637009 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=3 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:08.637980 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=3 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:08.639687 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=3 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:08.929323 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-aa000eab-2326-4457-9951-ce8b35df3ff2 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b831b040>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:09.641046 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-aa000eab-2326-4457-9951-ce8b35df3ff2 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/a5281343-901e-4411-bcc4-b8ca6c28ba27" status: 200 len: 345 microversion: 2.1 time: 1.012671 Sep 26 05:29:09.642652 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 1/2] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 05:29:08 2022] GET /compute/v2.1/os-volumes/a5281343-901e-4411-bcc4-b8ca6c28ba27 => generated 345 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:09.660418 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c869c7f1-77f6-49e0-abff-778d789e597e tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Action: 'create', calling method: .version_select at 0x7fd7b8197310>, body: {"snapshot": {"volume_id": "a5281343-901e-4411-bcc4-b8ca6c28ba27", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-637684930"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:29:10.091650 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c869c7f1-77f6-49e0-abff-778d789e597e tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.436106 Sep 26 05:29:10.095403 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 2/3] 10.222.0.49 () {60 vars in 1162 bytes} [Mon Sep 26 05:29:09 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:29:10.113448 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e2e37b43-7ebc-487b-96a4-c930eb776888 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b8186310>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:10.455990 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e2e37b43-7ebc-487b-96a4-c930eb776888 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168" status: 200 len: 286 microversion: 2.1 time: 0.354641 Sep 26 05:29:10.470373 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 05:29:10 2022] GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168 => generated 286 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:10.473635 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-75d8e4e3-3fc5-4ae2-9da6-8e2f2c634b2f tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b812b5e0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:10.521563 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-75d8e4e3-3fc5-4ae2-9da6-8e2f2c634b2f tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.054397 Sep 26 05:29:10.535667 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 3/5] 10.222.0.49 () {58 vars in 1140 bytes} [Mon Sep 26 05:29:10 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:10.539164 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-18b769ab-ee6a-4676-a2dd-bc7a3b6803fc tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b8186a60>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:10.585872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-18b769ab-ee6a-4676-a2dd-bc7a3b6803fc tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168" status: 200 len: 286 microversion: 2.1 time: 0.051552 Sep 26 05:29:10.592091 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 3/6] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 05:29:10 2022] GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:11.600049 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-49ca93fa-cbd6-4ead-a214-2aaa7d52114f tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b812bc10>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:11.648354 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-49ca93fa-cbd6-4ead-a214-2aaa7d52114f tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168" status: 200 len: 286 microversion: 2.1 time: 0.052070 Sep 26 05:29:11.649251 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 05:29:11 2022] GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:12.662046 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-06df32f9-8539-4b4a-ad66-3a47efff2616 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b8186ca0>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:12.725105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-06df32f9-8539-4b4a-ad66-3a47efff2616 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168" status: 200 len: 286 microversion: 2.1 time: 0.066654 Sep 26 05:29:12.732165 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 05:29:12 2022] GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:13.742397 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3f0d9e3f-34ac-49b4-a312-311c89e99a34 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b812b310>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:13.832138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3f0d9e3f-34ac-49b4-a312-311c89e99a34 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168" status: 200 len: 287 microversion: 2.1 time: 0.095317 Sep 26 05:29:13.839800 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 5/9] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 05:29:13 2022] GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168 => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:13.846309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-16ecd2a5-7b81-4958-a6fa-c1d853318ae6 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b81864c0>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:13.976188 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-16ecd2a5-7b81-4958-a6fa-c1d853318ae6 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168" status: 202 len: 0 microversion: 2.1 time: 0.132853 Sep 26 05:29:13.977126 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 5/10] 10.222.0.49 () {58 vars in 1254 bytes} [Mon Sep 26 05:29:13 2022] DELETE /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:29:13.986941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bdf286cb-18a0-4ede-8299-3fe30238ca03 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b8197c10>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:14.090753 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bdf286cb-18a0-4ede-8299-3fe30238ca03 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168" status: 200 len: 286 microversion: 2.1 time: 0.109539 Sep 26 05:29:14.091549 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 6/11] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 05:29:13 2022] GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168 => generated 286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:15.107304 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a27f5413-5abd-41a1-8ad4-df13620b6a91 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b81981f0>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:15.175258 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a27f5413-5abd-41a1-8ad4-df13620b6a91 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168" status: 200 len: 286 microversion: 2.1 time: 0.075604 Sep 26 05:29:15.176070 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 05:29:15 2022] GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:16.189729 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b1e60dff-4f01-4867-bb57-8a3b38ab2408 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b812b430>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:16.253263 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b1e60dff-4f01-4867-bb57-8a3b38ab2408 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168" status: 200 len: 286 microversion: 2.1 time: 0.067387 Sep 26 05:29:16.253847 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 05:29:16 2022] GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:17.270680 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-25078bb1-84aa-4fee-a8ef-2b64daef0749 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b8186310>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:17.336702 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-25078bb1-84aa-4fee-a8ef-2b64daef0749 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168" status: 200 len: 286 microversion: 2.1 time: 0.073757 Sep 26 05:29:17.337640 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 7/14] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 05:29:17 2022] GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:17.775897 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8c803e14-51db-40e8-98e1-0fe85e6ecb2d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-762443975", "imageRef": "d37a4f3d-6311-48af-9e33-4c62c14cdd1a", "flavorRef": "452", "networks": [{"uuid": "57c648e4-fdcc-4713-bf51-b124d7faabd4"}]}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:29:17.940485 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-8c803e14-51db-40e8-98e1-0fe85e6ecb2d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] validate_networks() for [('57c648e4-fdcc-4713-bf51-b124d7faabd4', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:29:18.354313 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-ba880d1a-039d-42ad-8491-807d1915da15 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b8186af0>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:18.418783 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-ba880d1a-039d-42ad-8491-807d1915da15 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168" status: 200 len: 286 microversion: 2.1 time: 0.072451 Sep 26 05:29:18.419778 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 8/15] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 05:29:18 2022] GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:19.142451 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-8c803e14-51db-40e8-98e1-0fe85e6ecb2d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:29:19.147336 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-8c803e14-51db-40e8-98e1-0fe85e6ecb2d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:29:19.149100 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-8c803e14-51db-40e8-98e1-0fe85e6ecb2d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:29:19.150479 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-8c803e14-51db-40e8-98e1-0fe85e6ecb2d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:29:19.151107 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-8c803e14-51db-40e8-98e1-0fe85e6ecb2d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:29:19.177598 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8c803e14-51db-40e8-98e1-0fe85e6ecb2d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:19.177930 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8c803e14-51db-40e8-98e1-0fe85e6ecb2d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:19.179718 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8c803e14-51db-40e8-98e1-0fe85e6ecb2d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:19.180586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8c803e14-51db-40e8-98e1-0fe85e6ecb2d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:19.181051 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8c803e14-51db-40e8-98e1-0fe85e6ecb2d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:19.181484 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8c803e14-51db-40e8-98e1-0fe85e6ecb2d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:19.233029 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-8c803e14-51db-40e8-98e1-0fe85e6ecb2d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Getting quotas for project 0a676eb5cbd74956ba12b1d5595e3f18. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:29:19.242294 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-8c803e14-51db-40e8-98e1-0fe85e6ecb2d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Getting quotas for user 4056ea3d1a1d48f2a34e14df77914363 and project 0a676eb5cbd74956ba12b1d5595e3f18. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:29:19.276448 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8c803e14-51db-40e8-98e1-0fe85e6ecb2d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:29:19.283253 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8c803e14-51db-40e8-98e1-0fe85e6ecb2d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d37a4f3d-6311-48af-9e33-4c62c14cdd1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:29:19.435029 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3c6190e1-92a5-4fd2-936a-3d89545d693f tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b81983a0>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:19.442800 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8c803e14-51db-40e8-98e1-0fe85e6ecb2d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.945893 Sep 26 05:29:19.452687 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 8/16] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:29:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:29:19.468895 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5765f242-36c6-458e-be57-7425eb35639a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:19.476486 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5765f242-36c6-458e-be57-7425eb35639a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:19.504748 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-3c6190e1-92a5-4fd2-936a-3d89545d693f tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168" status: 200 len: 286 microversion: 2.1 time: 0.075102 Sep 26 05:29:19.505599 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 9/17] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 05:29:19 2022] GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:29:19.686506 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5765f242-36c6-458e-be57-7425eb35639a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:19.723351 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5765f242-36c6-458e-be57-7425eb35639a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1214 microversion: 2.1 time: 0.260136 Sep 26 05:29:19.749935 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 9/18] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:19 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1214 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:20.517912 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9c37e8a1-693e-4b66-85cb-8cd2d59ed203 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b785f430>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:20.577663 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-9c37e8a1-693e-4b66-85cb-8cd2d59ed203 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] HTTP exception thrown: Snapshot fb28b129-cd8b-4c4a-b5dd-edc344420168 could not be found. Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9c37e8a1-693e-4b66-85cb-8cd2d59ed203 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Request method failure captured: Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168 HTTP/1.1 Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTihe9Sgax92ugi8tgW_m4MEvXUHjirJpl9HMV6b6OuwnzdKL34SWLwBXo_NyxgXRNZTDNyYE8vmVm1rgQKqMH_vf3e_dJjfHPJkrU4Y6tRhgGE5qBVzYNq9diV2XhzXCypTYlwgWmzWRvNnvPdSlx1BPorOBKAZZwuZNIQLMFmEbLA Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: e666edf14c434665bec2a5f89efffc8c Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-101827016 Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:29:20.581748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:29:20.582832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e666edf14c434665bec2a5f89efffc8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e666edf14c434665bec2a5f89efffc8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e666edf14c434665bec2a5f89efffc8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e666edf14c434665bec2a5f89efffc8c"}]}] Sep 26 05:29:20.582832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-VolumesSnapshotsTestJSON-101827016 Sep 26 05:29:20.582832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: e666edf14c434665bec2a5f89efffc8c Sep 26 05:29:20.582832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-101827016 Sep 26 05:29:20.582832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-VolumesSnapshotsTestJSON-101827016-project Sep 26 05:29:20.582832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:29:20.582832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:29:20.582832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 3dca1fc7b21148639d328bc371158494 Sep 26 05:29:20.582832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-VolumesSnapshotsTestJSON-101827016-project Sep 26 05:29:20.582832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: Sep 26 05:29:20.582832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Snapshot fb28b129-cd8b-4c4a-b5dd-edc344420168 could not be found. Sep 26 05:29:20.582832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': 'fb28b129-cd8b-4c4a-b5dd-edc344420168'} Sep 26 05:29:20.582832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:29:20.583481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:20.583481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 26 05:29:20.583481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 26 05:29:20.583481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 26 05:29:20.583481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 26 05:29:20.583481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 26 05:29:20.583481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 26 05:29:20.583481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:29:20.583481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:29:20.583481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:29:20.583481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:29:20.583481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:29:20.583481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:29:20.583481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:29:20.583481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:29:20.583481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fb28b129-cd8b-4c4a-b5dd-edc344420168 could not be found. (HTTP 404) (Request-ID: req-a6edee01-2df1-4577-9a7f-17c16e13f33c) Sep 26 05:29:20.583481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:20.583481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:29:20.585955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fb28b129-cd8b-4c4a-b5dd-edc344420168 could not be found. Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 26 05:29:20.588200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:29:20.591532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fb28b129-cd8b-4c4a-b5dd-edc344420168 could not be found. Sep 26 05:29:20.591532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:20.591532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:29:20.591532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:20.591532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:20.591532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:29:20.591532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:29:20.591532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:29:20.591532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:29:20.591532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fb28b129-cd8b-4c4a-b5dd-edc344420168 could not be found. Sep 26 05:29:20.591532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:20.591532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9c37e8a1-693e-4b66-85cb-8cd2d59ed203 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Returning 404 to user: Snapshot fb28b129-cd8b-4c4a-b5dd-edc344420168 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:29:20.591532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9c37e8a1-693e-4b66-85cb-8cd2d59ed203 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168" status: 404 len: 111 microversion: 2.1 time: 0.069213 Sep 26 05:29:20.591532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 10/19] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 05:29:20 2022] GET /compute/v2.1/os-snapshots/fb28b129-cd8b-4c4a-b5dd-edc344420168 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:29:20.594009 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-20343480-aa28-4762-abc9-49a4a8b5bfa2 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b8af1940>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:20.834680 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-20343480-aa28-4762-abc9-49a4a8b5bfa2 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/a5281343-901e-4411-bcc4-b8ca6c28ba27" status: 202 len: 0 microversion: 2.1 time: 0.244992 Sep 26 05:29:20.835851 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 11/20] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 05:29:20 2022] DELETE /compute/v2.1/os-volumes/a5281343-901e-4411-bcc4-b8ca6c28ba27 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:29:20.849099 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-32631489-aae6-4610-b6ed-8d8f0f6fa24a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:20.853787 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-32631489-aae6-4610-b6ed-8d8f0f6fa24a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:21.050067 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-32631489-aae6-4610-b6ed-8d8f0f6fa24a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:21.082308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-32631489-aae6-4610-b6ed-8d8f0f6fa24a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1214 microversion: 2.1 time: 0.237859 Sep 26 05:29:21.092590 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 12/21] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:20 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1214 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:21.142762 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-70949f9a-1601-4b1a-8c1c-db52454096a9 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b77cd5e0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:21.152027 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b7606b39-0146-4df8-a80f-95f778ab97d9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2133399627", "imageRef": "d37a4f3d-6311-48af-9e33-4c62c14cdd1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:29:21.227092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-70949f9a-1601-4b1a-8c1c-db52454096a9 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] HTTP exception thrown: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-70949f9a-1601-4b1a-8c1c-db52454096a9 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Request method failure captured: Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/os-volumes/a5281343-901e-4411-bcc4-b8ca6c28ba27 HTTP/1.1 Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTihe9Sgax92ugi8tgW_m4MEvXUHjirJpl9HMV6b6OuwnzdKL34SWLwBXo_NyxgXRNZTDNyYE8vmVm1rgQKqMH_vf3e_dJjfHPJkrU4Y6tRhgGE5qBVzYNq9diV2XhzXCypTYlwgWmzWRvNnvPdSlx1BPorOBKAZZwuZNIQLMFmEbLA Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: e666edf14c434665bec2a5f89efffc8c Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-101827016 Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:29:21.230877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:29:21.232153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e666edf14c434665bec2a5f89efffc8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e666edf14c434665bec2a5f89efffc8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e666edf14c434665bec2a5f89efffc8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e666edf14c434665bec2a5f89efffc8c"}]}] Sep 26 05:29:21.232153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-VolumesSnapshotsTestJSON-101827016 Sep 26 05:29:21.232153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: e666edf14c434665bec2a5f89efffc8c Sep 26 05:29:21.232153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-101827016 Sep 26 05:29:21.232153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-VolumesSnapshotsTestJSON-101827016-project Sep 26 05:29:21.232153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:29:21.232153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:29:21.232153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 3dca1fc7b21148639d328bc371158494 Sep 26 05:29:21.232153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-VolumesSnapshotsTestJSON-101827016-project Sep 26 05:29:21.232153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: Sep 26 05:29:21.232153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. Sep 26 05:29:21.232153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': 'a5281343-901e-4411-bcc4-b8ca6c28ba27'} Sep 26 05:29:21.232153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. (HTTP 404) (Request-ID: req-fc48452d-d4b1-4dfd-b59b-a01fd63aaca5) Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:29:21.232906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:29:21.233887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 05:29:21.234892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:29:21.236193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. Sep 26 05:29:21.236193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.236193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:29:21.236193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.236193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:21.236193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:29:21.236193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:29:21.236193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:29:21.236193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:29:21.236193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. Sep 26 05:29:21.236193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.237277 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-70949f9a-1601-4b1a-8c1c-db52454096a9 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Returning 404 to user: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:29:21.238783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-70949f9a-1601-4b1a-8c1c-db52454096a9 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/a5281343-901e-4411-bcc4-b8ca6c28ba27" status: 404 len: 109 microversion: 2.1 time: 0.144372 Sep 26 05:29:21.239654 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 13/22] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 05:29:21 2022] GET /compute/v2.1/os-volumes/a5281343-901e-4411-bcc4-b8ca6c28ba27 => generated 109 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:29:21.261398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7bb9a743-f526-4562-bf39-2e0dfa6b4215 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b7846160>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:21.372549 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-7bb9a743-f526-4562-bf39-2e0dfa6b4215 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] HTTP exception thrown: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7bb9a743-f526-4562-bf39-2e0dfa6b4215 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Request method failure captured: Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: DELETE /compute/v2.1/os-volumes/a5281343-901e-4411-bcc4-b8ca6c28ba27 HTTP/1.1 Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTihe9Sgax92ugi8tgW_m4MEvXUHjirJpl9HMV6b6OuwnzdKL34SWLwBXo_NyxgXRNZTDNyYE8vmVm1rgQKqMH_vf3e_dJjfHPJkrU4Y6tRhgGE5qBVzYNq9diV2XhzXCypTYlwgWmzWRvNnvPdSlx1BPorOBKAZZwuZNIQLMFmEbLA Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: e666edf14c434665bec2a5f89efffc8c Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-101827016 Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:29:21.375360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:29:21.376616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e666edf14c434665bec2a5f89efffc8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e666edf14c434665bec2a5f89efffc8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e666edf14c434665bec2a5f89efffc8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e666edf14c434665bec2a5f89efffc8c"}]}] Sep 26 05:29:21.376616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-VolumesSnapshotsTestJSON-101827016 Sep 26 05:29:21.376616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: e666edf14c434665bec2a5f89efffc8c Sep 26 05:29:21.376616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-101827016 Sep 26 05:29:21.376616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-VolumesSnapshotsTestJSON-101827016-project Sep 26 05:29:21.376616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:29:21.376616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:29:21.376616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 3dca1fc7b21148639d328bc371158494 Sep 26 05:29:21.376616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-VolumesSnapshotsTestJSON-101827016-project Sep 26 05:29:21.376616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: Sep 26 05:29:21.376616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. Sep 26 05:29:21.376616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': 'a5281343-901e-4411-bcc4-b8ca6c28ba27'} Sep 26 05:29:21.376616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. (HTTP 404) (Request-ID: req-ff28c4e8-f8ea-49c9-b31c-b7005699416f) Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:29:21.380213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 05:29:21.382178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 26 05:29:21.383308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:29:21.384453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. Sep 26 05:29:21.384453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.384453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:29:21.384453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.384453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:21.384453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:29:21.384453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:29:21.384453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:29:21.384453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:29:21.384453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. Sep 26 05:29:21.384453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.384453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7bb9a743-f526-4562-bf39-2e0dfa6b4215 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Returning 404 to user: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:29:21.384453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7bb9a743-f526-4562-bf39-2e0dfa6b4215 tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/a5281343-901e-4411-bcc4-b8ca6c28ba27" status: 404 len: 109 microversion: 2.1 time: 0.131438 Sep 26 05:29:21.384453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 14/23] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 05:29:21 2022] DELETE /compute/v2.1/os-volumes/a5281343-901e-4411-bcc4-b8ca6c28ba27 => generated 109 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:29:21.387619 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-38ffdd49-3683-4cfa-be2f-d9f12cd552ba tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Calling method '.version_select at 0x7fd7b77aaaf0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:21.422401 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.network.neutron [None req-b7606b39-0146-4df8-a80f-95f778ab97d9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] validate_networks() for [('7a42108c-0615-4b7d-80da-4c23f250e4d0', None, None, None, None, None)] {{(pid=120806) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:29:21.497393 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-38ffdd49-3683-4cfa-be2f-d9f12cd552ba tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] HTTP exception thrown: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-38ffdd49-3683-4cfa-be2f-d9f12cd552ba tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Request method failure captured: Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/os-volumes/a5281343-901e-4411-bcc4-b8ca6c28ba27 HTTP/1.1 Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTihe9Sgax92ugi8tgW_m4MEvXUHjirJpl9HMV6b6OuwnzdKL34SWLwBXo_NyxgXRNZTDNyYE8vmVm1rgQKqMH_vf3e_dJjfHPJkrU4Y6tRhgGE5qBVzYNq9diV2XhzXCypTYlwgWmzWRvNnvPdSlx1BPorOBKAZZwuZNIQLMFmEbLA Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: e666edf14c434665bec2a5f89efffc8c Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-101827016 Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:29:21.499536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:29:21.501006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e666edf14c434665bec2a5f89efffc8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e666edf14c434665bec2a5f89efffc8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e666edf14c434665bec2a5f89efffc8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e666edf14c434665bec2a5f89efffc8c"}]}] Sep 26 05:29:21.501006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-VolumesSnapshotsTestJSON-101827016 Sep 26 05:29:21.501006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: e666edf14c434665bec2a5f89efffc8c Sep 26 05:29:21.501006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-101827016 Sep 26 05:29:21.501006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-VolumesSnapshotsTestJSON-101827016-project Sep 26 05:29:21.501006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:29:21.501006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:29:21.501006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 3dca1fc7b21148639d328bc371158494 Sep 26 05:29:21.501006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-VolumesSnapshotsTestJSON-101827016-project Sep 26 05:29:21.501006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: Sep 26 05:29:21.501006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. Sep 26 05:29:21.501006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': 'a5281343-901e-4411-bcc4-b8ca6c28ba27'} Sep 26 05:29:21.501006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. (HTTP 404) (Request-ID: req-c7cfe58d-adf1-4fd0-93ea-acbf971685b8) Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:29:21.501658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:29:21.502581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 05:29:21.503493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:29:21.506116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. Sep 26 05:29:21.506116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.506116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:29:21.506116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.506116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:21.506116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:29:21.506116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:29:21.506116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:29:21.506116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:29:21.506116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. Sep 26 05:29:21.506116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:29:21.506116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-38ffdd49-3683-4cfa-be2f-d9f12cd552ba tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] Returning 404 to user: Volume a5281343-901e-4411-bcc4-b8ca6c28ba27 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:29:21.506116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-38ffdd49-3683-4cfa-be2f-d9f12cd552ba tempest-VolumesSnapshotsTestJSON-101827016 tempest-VolumesSnapshotsTestJSON-101827016-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/a5281343-901e-4411-bcc4-b8ca6c28ba27" status: 404 len: 109 microversion: 2.1 time: 0.120116 Sep 26 05:29:21.506116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 15/24] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 05:29:21 2022] GET /compute/v2.1/os-volumes/a5281343-901e-4411-bcc4-b8ca6c28ba27 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:29:22.122659 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-46fe64a9-716a-408b-a8b6-6f5accf22a52 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:22.123312 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-46fe64a9-716a-408b-a8b6-6f5accf22a52 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:22.150342 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46fe64a9-716a-408b-a8b6-6f5accf22a52 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:22.152801 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46fe64a9-716a-408b-a8b6-6f5accf22a52 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:22.156514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46fe64a9-716a-408b-a8b6-6f5accf22a52 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:22.158945 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46fe64a9-716a-408b-a8b6-6f5accf22a52 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:22.161033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46fe64a9-716a-408b-a8b6-6f5accf22a52 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:22.163836 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46fe64a9-716a-408b-a8b6-6f5accf22a52 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:22.801227 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-46fe64a9-716a-408b-a8b6-6f5accf22a52 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:22.837185 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-46fe64a9-716a-408b-a8b6-6f5accf22a52 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1218 microversion: 2.1 time: 0.726378 Sep 26 05:29:22.841690 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 16/25] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:22 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1218 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:24.026296 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cae7f07e-e96d-4d49-8e4b-330c215ff4cf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Action: 'create', calling method: .version_select at 0x7fd7b7758790>, body: {"keypair": {"name": "tempest-keypair-1146200819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjq4d3W0gYW5PCMbRcOLNhat3C+hVCcRY3ZmPC6ESrtVPk6vZL21pQr3eL/sDjPE2zlKEC9p+3sRt54nKCB792hPzgZthhrZ4uKJOUCSOZR+BWleIrPNuIuKlhacVggwA=="}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:29:24.116841 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-b7606b39-0146-4df8-a80f-95f778ab97d9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Flavor limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:29:24.117420 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-b7606b39-0146-4df8-a80f-95f778ab97d9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Image limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:29:24.117871 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-b7606b39-0146-4df8-a80f-95f778ab97d9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Flavor pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:29:24.118281 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-b7606b39-0146-4df8-a80f-95f778ab97d9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Image pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:29:24.118697 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-b7606b39-0146-4df8-a80f-95f778ab97d9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:29:24.121718 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-cae7f07e-e96d-4d49-8e4b-330c215ff4cf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Getting quotas for project e5e1c15ae90e4b82b4e216b3a0549e2e. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:29:24.138258 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-cae7f07e-e96d-4d49-8e4b-330c215ff4cf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Getting quotas for user a8f59b47841a4b62b8e368562c7bd210 and project e5e1c15ae90e4b82b4e216b3a0549e2e. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:29:24.160320 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b7606b39-0146-4df8-a80f-95f778ab97d9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:24.163419 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b7606b39-0146-4df8-a80f-95f778ab97d9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:24.163900 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b7606b39-0146-4df8-a80f-95f778ab97d9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:24.166898 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b7606b39-0146-4df8-a80f-95f778ab97d9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:24.168863 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b7606b39-0146-4df8-a80f-95f778ab97d9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:24.169321 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b7606b39-0146-4df8-a80f-95f778ab97d9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:24.309133 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cae7f07e-e96d-4d49-8e4b-330c215ff4cf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.668628 Sep 26 05:29:24.321679 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 17/26] 10.222.0.49 () {62 vars in 1200 bytes} [Mon Sep 26 05:29:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 682 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 26 05:29:24.330196 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-b7606b39-0146-4df8-a80f-95f778ab97d9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Getting quotas for project 01c8f7766cb646b7b646a53c9de8e91a. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:29:24.346986 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ce9e8a45-36b0-40d1-aac1-5c333840a6fe tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:24.347623 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ce9e8a45-36b0-40d1-aac1-5c333840a6fe tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:24.354329 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-b7606b39-0146-4df8-a80f-95f778ab97d9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Getting quotas for user 683c4d41fa4a452ba8210e62dd43f7f4 and project 01c8f7766cb646b7b646a53c9de8e91a. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:29:24.377749 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ce9e8a45-36b0-40d1-aac1-5c333840a6fe tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:24.378258 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ce9e8a45-36b0-40d1-aac1-5c333840a6fe tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:24.378692 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ce9e8a45-36b0-40d1-aac1-5c333840a6fe tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:24.382549 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ce9e8a45-36b0-40d1-aac1-5c333840a6fe tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:24.384726 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ce9e8a45-36b0-40d1-aac1-5c333840a6fe tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:24.385339 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ce9e8a45-36b0-40d1-aac1-5c333840a6fe tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:24.432641 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b7606b39-0146-4df8-a80f-95f778ab97d9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Going to run 1 instances... {{(pid=120806) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:29:24.444980 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b7606b39-0146-4df8-a80f-95f778ab97d9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d37a4f3d-6311-48af-9e33-4c62c14cdd1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120806) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:29:24.761975 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b7606b39-0146-4df8-a80f-95f778ab97d9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.479975 Sep 26 05:29:24.765722 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 10/27] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:29:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 4491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:29:24.920069 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d490b9d6-5b80-41ec-bcd9-c97829e8d4af tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Action: 'create', calling method: .version_select at 0x7fd7b78383a0>, body: {"keypair": {"name": "tempest-keypair-245433757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyMV6qDD9IJgjDFSwx3WKeeoaxSTKyyv7Oq66kgNXqcGGPN1sNa7bYy24WRnWDQQGUJXnlwchxbKODYkqTf9Vu7j19XHw6bIvzf99v1yPWnVLo07uQJH8Cigu/1h9mVLg=="}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:29:25.030182 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-d490b9d6-5b80-41ec-bcd9-c97829e8d4af tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Getting quotas for project fd13dd8ec810435491e3f3cba7cca4d1. Resources: {'key_pairs'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:29:25.045948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-d490b9d6-5b80-41ec-bcd9-c97829e8d4af tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Getting quotas for user 48e588ff6d5a4a37b902abadfb6d04fc and project fd13dd8ec810435491e3f3cba7cca4d1. Resources: {'key_pairs'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:29:25.190754 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ce9e8a45-36b0-40d1-aac1-5c333840a6fe tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:25.195331 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d490b9d6-5b80-41ec-bcd9-c97829e8d4af tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.427100 Sep 26 05:29:25.199328 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 11/28] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 05:29:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:25.207770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ce9e8a45-36b0-40d1-aac1-5c333840a6fe tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1272 microversion: 2.1 time: 0.883058 Sep 26 05:29:25.211363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 18/29] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:24 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1272 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:25.221153 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f3f9efb7-20cf-46f1-8a48-630308dd74ca tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:25.225946 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f3f9efb7-20cf-46f1-8a48-630308dd74ca tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:25.516950 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f3f9efb7-20cf-46f1-8a48-630308dd74ca tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:25.562676 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f3f9efb7-20cf-46f1-8a48-630308dd74ca tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1222 microversion: 2.1 time: 0.359208 Sep 26 05:29:25.563552 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 12/30] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:25 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1222 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:25.921649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-26ba75f4-f217-4185-aede-bd91258c465c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1867425723", "imageRef": "d37a4f3d-6311-48af-9e33-4c62c14cdd1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:29:26.120668 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-26ba75f4-f217-4185-aede-bd91258c465c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] validate_networks() for [('7a42108c-0615-4b7d-80da-4c23f250e4d0', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:29:26.233642 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f1d50260-e6b4-4470-b08f-fc5b1a349023 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:26.234247 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f1d50260-e6b4-4470-b08f-fc5b1a349023 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:26.255243 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f1d50260-e6b4-4470-b08f-fc5b1a349023 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:26.261786 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f1d50260-e6b4-4470-b08f-fc5b1a349023 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:26.263954 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f1d50260-e6b4-4470-b08f-fc5b1a349023 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:26.267408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f1d50260-e6b4-4470-b08f-fc5b1a349023 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:26.270913 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f1d50260-e6b4-4470-b08f-fc5b1a349023 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:26.277613 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f1d50260-e6b4-4470-b08f-fc5b1a349023 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:27.534729 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f1d50260-e6b4-4470-b08f-fc5b1a349023 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:27.610973 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f1d50260-e6b4-4470-b08f-fc5b1a349023 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1272 microversion: 2.1 time: 1.369016 Sep 26 05:29:27.613905 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 13/31] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:26 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1272 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:27.975748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-26ba75f4-f217-4185-aede-bd91258c465c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:29:27.976395 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-26ba75f4-f217-4185-aede-bd91258c465c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:29:27.976707 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-26ba75f4-f217-4185-aede-bd91258c465c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:29:27.977343 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-26ba75f4-f217-4185-aede-bd91258c465c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:29:27.977924 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-26ba75f4-f217-4185-aede-bd91258c465c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:29:28.001782 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-26ba75f4-f217-4185-aede-bd91258c465c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:28.009773 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-26ba75f4-f217-4185-aede-bd91258c465c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:28.010426 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-26ba75f4-f217-4185-aede-bd91258c465c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:28.011488 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-26ba75f4-f217-4185-aede-bd91258c465c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:28.012224 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-26ba75f4-f217-4185-aede-bd91258c465c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:28.012968 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-26ba75f4-f217-4185-aede-bd91258c465c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:28.087123 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-26ba75f4-f217-4185-aede-bd91258c465c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Getting quotas for project 01c8f7766cb646b7b646a53c9de8e91a. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:29:28.141651 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-26ba75f4-f217-4185-aede-bd91258c465c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Getting quotas for user 683c4d41fa4a452ba8210e62dd43f7f4 and project 01c8f7766cb646b7b646a53c9de8e91a. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:29:28.199984 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-26ba75f4-f217-4185-aede-bd91258c465c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:29:28.207467 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-26ba75f4-f217-4185-aede-bd91258c465c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d37a4f3d-6311-48af-9e33-4c62c14cdd1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:29:28.386268 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-26ba75f4-f217-4185-aede-bd91258c465c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.470886 Sep 26 05:29:28.389875 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 19/32] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:29:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:29:28.408849 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-23d48495-9a3a-4436-8346-b4e122b7d235 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:28.408849 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-23d48495-9a3a-4436-8346-b4e122b7d235 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:28.641745 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-04195859-cc6a-47dd-b084-b19d8e0ead1c tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:28.645279 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-04195859-cc6a-47dd-b084-b19d8e0ead1c tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:28.668856 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-04195859-cc6a-47dd-b084-b19d8e0ead1c tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:28.671021 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-04195859-cc6a-47dd-b084-b19d8e0ead1c tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:28.671325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-23d48495-9a3a-4436-8346-b4e122b7d235 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:28.672717 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-04195859-cc6a-47dd-b084-b19d8e0ead1c tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:28.674167 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-04195859-cc6a-47dd-b084-b19d8e0ead1c tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:28.674826 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-04195859-cc6a-47dd-b084-b19d8e0ead1c tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:28.682763 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-04195859-cc6a-47dd-b084-b19d8e0ead1c tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:28.687024 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-23d48495-9a3a-4436-8346-b4e122b7d235 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1222 microversion: 2.1 time: 0.286677 Sep 26 05:29:28.700964 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 14/33] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:28 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1222 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:29.207578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-04195859-cc6a-47dd-b084-b19d8e0ead1c tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:29.227614 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-04195859-cc6a-47dd-b084-b19d8e0ead1c tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.586533 Sep 26 05:29:29.229375 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 20/34] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:28 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:29.717280 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-65c720c0-8adf-4676-9cb1-a579d9a0846d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:29.718534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-65c720c0-8adf-4676-9cb1-a579d9a0846d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:29.918239 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-65c720c0-8adf-4676-9cb1-a579d9a0846d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:29.930952 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-65c720c0-8adf-4676-9cb1-a579d9a0846d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1222 microversion: 2.1 time: 0.217005 Sep 26 05:29:29.931797 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 21/35] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:29 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1222 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:30.136718 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c7a85e3d-344a-4d90-b5b9-d8970f161854 tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] Action: 'create', calling method: .version_select at 0x7fd7b7744af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-30962960", "metadata": {"Type": "work"}}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:29:30.263174 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-493f38c6-64ae-4e13-a8d7-14b23464887f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:30.264656 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-493f38c6-64ae-4e13-a8d7-14b23464887f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:30.285395 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-493f38c6-64ae-4e13-a8d7-14b23464887f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:30.288430 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-493f38c6-64ae-4e13-a8d7-14b23464887f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:30.291297 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-493f38c6-64ae-4e13-a8d7-14b23464887f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:30.292457 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-493f38c6-64ae-4e13-a8d7-14b23464887f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:30.296976 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-493f38c6-64ae-4e13-a8d7-14b23464887f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:30.297660 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-493f38c6-64ae-4e13-a8d7-14b23464887f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:30.905592 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c7a85e3d-344a-4d90-b5b9-d8970f161854 tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 2.086733 Sep 26 05:29:30.906749 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 15/36] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Sep 26 05:29:28 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 2089 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 26 05:29:30.921046 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a102cf2b-b6a3-43a0-afed-02487d79de0a tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] Calling method '.version_select at 0x7fd7b77a2040>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:31.022371 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a102cf2b-b6a3-43a0-afed-02487d79de0a tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2e2b2eef-a332-4407-9313-8935cfe954b3" status: 200 len: 351 microversion: 2.1 time: 0.105564 Sep 26 05:29:31.023076 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 16/37] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 05:29:30 2022] GET /compute/v2.1/os-volumes/2e2b2eef-a332-4407-9313-8935cfe954b3 => generated 351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:31.032568 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-716b4233-7247-495e-9676-1e8ed6f245a2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:31.032568 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-716b4233-7247-495e-9676-1e8ed6f245a2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:31.047458 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-716b4233-7247-495e-9676-1e8ed6f245a2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:31.049004 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-716b4233-7247-495e-9676-1e8ed6f245a2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:31.049694 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-716b4233-7247-495e-9676-1e8ed6f245a2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:31.053504 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-716b4233-7247-495e-9676-1e8ed6f245a2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:31.054537 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-716b4233-7247-495e-9676-1e8ed6f245a2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:31.055132 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-716b4233-7247-495e-9676-1e8ed6f245a2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:31.193451 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-493f38c6-64ae-4e13-a8d7-14b23464887f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:31.210638 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-493f38c6-64ae-4e13-a8d7-14b23464887f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.948997 Sep 26 05:29:31.211629 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 22/38] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:30 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:31.306911 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-716b4233-7247-495e-9676-1e8ed6f245a2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:31.322820 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-716b4233-7247-495e-9676-1e8ed6f245a2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1226 microversion: 2.1 time: 0.297262 Sep 26 05:29:31.347560 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 17/39] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:31 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1226 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:31.442963 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ea54c74a-bb74-4e58-a603-bd0095feec4b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1033401843", "imageRef": "d37a4f3d-6311-48af-9e33-4c62c14cdd1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a033fac-5647-47c1-8abf-96bf265545b0"}], "security_groups": [{"name": "tempest-securitygroup--869215393"}], "key_name": "tempest-keypair-1146200819", "user_data": "}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:29:31.746963 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-ea54c74a-bb74-4e58-a603-bd0095feec4b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] validate_networks() for [('7a033fac-5647-47c1-8abf-96bf265545b0', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:29:32.037971 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-34ae91ec-8d6c-4658-b0d7-18ee08e56e39 tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] Calling method '.version_select at 0x7fd7b7744670>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:32.151729 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-34ae91ec-8d6c-4658-b0d7-18ee08e56e39 tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2e2b2eef-a332-4407-9313-8935cfe954b3" status: 200 len: 351 microversion: 2.1 time: 0.118186 Sep 26 05:29:32.152837 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 18/40] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 05:29:32 2022] GET /compute/v2.1/os-volumes/2e2b2eef-a332-4407-9313-8935cfe954b3 => generated 351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:32.244562 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-8b266bd7-8cc4-42c2-9167-6fa911311d79 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:32.245987 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-8b266bd7-8cc4-42c2-9167-6fa911311d79 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:32.263944 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8b266bd7-8cc4-42c2-9167-6fa911311d79 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:32.273643 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8b266bd7-8cc4-42c2-9167-6fa911311d79 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:32.275947 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8b266bd7-8cc4-42c2-9167-6fa911311d79 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:32.278118 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8b266bd7-8cc4-42c2-9167-6fa911311d79 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:32.281096 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8b266bd7-8cc4-42c2-9167-6fa911311d79 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:32.285424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8b266bd7-8cc4-42c2-9167-6fa911311d79 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:33.368184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8b266bd7-8cc4-42c2-9167-6fa911311d79 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:33.394500 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-8b266bd7-8cc4-42c2-9167-6fa911311d79 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 1.159601 Sep 26 05:29:33.408400 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 19/41] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:32 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:33.436726 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-4964f2ee-e27d-4974-bef6-66cfef14b80d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:33.441666 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-4964f2ee-e27d-4974-bef6-66cfef14b80d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:33.482807 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4964f2ee-e27d-4974-bef6-66cfef14b80d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:33.486617 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4964f2ee-e27d-4974-bef6-66cfef14b80d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:33.487283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4964f2ee-e27d-4974-bef6-66cfef14b80d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:33.488409 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4964f2ee-e27d-4974-bef6-66cfef14b80d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:33.491270 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4964f2ee-e27d-4974-bef6-66cfef14b80d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:33.493521 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4964f2ee-e27d-4974-bef6-66cfef14b80d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:33.675172 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-4964f2ee-e27d-4974-bef6-66cfef14b80d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:33.706615 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-4964f2ee-e27d-4974-bef6-66cfef14b80d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1274 microversion: 2.1 time: 0.294898 Sep 26 05:29:33.707649 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 20/42] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:33 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1274 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:33.742309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-65451b4a-f063-4158-aca2-0314640fd5d1 tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] Calling method '.version_select at 0x7fd7b76e7310>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:34.004009 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-65451b4a-f063-4158-aca2-0314640fd5d1 tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2e2b2eef-a332-4407-9313-8935cfe954b3" status: 200 len: 352 microversion: 2.1 time: 0.294958 Sep 26 05:29:34.005288 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 21/43] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 05:29:33 2022] GET /compute/v2.1/os-volumes/2e2b2eef-a332-4407-9313-8935cfe954b3 => generated 352 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:34.022811 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1cf57522-1cc0-4d70-99f2-7d39e25c1ace tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] Calling method '.version_select at 0x7fd7b76e7670>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:34.109846 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-ea54c74a-bb74-4e58-a603-bd0095feec4b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:29:34.111587 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-ea54c74a-bb74-4e58-a603-bd0095feec4b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:29:34.112320 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-ea54c74a-bb74-4e58-a603-bd0095feec4b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:29:34.113600 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-ea54c74a-bb74-4e58-a603-bd0095feec4b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:29:34.114242 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-ea54c74a-bb74-4e58-a603-bd0095feec4b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:29:34.145164 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ea54c74a-bb74-4e58-a603-bd0095feec4b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:34.150413 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ea54c74a-bb74-4e58-a603-bd0095feec4b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:34.153798 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ea54c74a-bb74-4e58-a603-bd0095feec4b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:34.155024 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ea54c74a-bb74-4e58-a603-bd0095feec4b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:34.158815 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ea54c74a-bb74-4e58-a603-bd0095feec4b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:34.163222 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ea54c74a-bb74-4e58-a603-bd0095feec4b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:34.254639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:34.257895 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1cf57522-1cc0-4d70-99f2-7d39e25c1ace tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2e2b2eef-a332-4407-9313-8935cfe954b3" status: 200 len: 352 microversion: 2.1 time: 0.241758 Sep 26 05:29:34.259097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 22/44] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 05:29:34 2022] GET /compute/v2.1/os-volumes/2e2b2eef-a332-4407-9313-8935cfe954b3 => generated 352 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:29:34.270406 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-ea54c74a-bb74-4e58-a603-bd0095feec4b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Getting quotas for project e5e1c15ae90e4b82b4e216b3a0549e2e. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:29:34.280600 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-253fc213-81bf-4e17-901b-721164260b8f tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] Calling method '.version_select at 0x7fd7b76ecc10>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:34.307346 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-ea54c74a-bb74-4e58-a603-bd0095feec4b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Getting quotas for user a8f59b47841a4b62b8e368562c7bd210 and project e5e1c15ae90e4b82b4e216b3a0549e2e. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:29:34.346471 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ea54c74a-bb74-4e58-a603-bd0095feec4b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:29:34.354121 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ea54c74a-bb74-4e58-a603-bd0095feec4b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d37a4f3d-6311-48af-9e33-4c62c14cdd1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:29:34.462754 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-253fc213-81bf-4e17-901b-721164260b8f tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/2e2b2eef-a332-4407-9313-8935cfe954b3" status: 202 len: 0 microversion: 2.1 time: 0.189732 Sep 26 05:29:34.463513 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 23/45] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 05:29:34 2022] DELETE /compute/v2.1/os-volumes/2e2b2eef-a332-4407-9313-8935cfe954b3 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 05:29:34.470473 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b5ee7739-121e-4b95-8a62-0a28600e86f5 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:34.471232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b5ee7739-121e-4b95-8a62-0a28600e86f5 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:34.516858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b5ee7739-121e-4b95-8a62-0a28600e86f5 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:34.517433 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b5ee7739-121e-4b95-8a62-0a28600e86f5 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:34.518036 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b5ee7739-121e-4b95-8a62-0a28600e86f5 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:34.518756 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b5ee7739-121e-4b95-8a62-0a28600e86f5 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:34.527074 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b5ee7739-121e-4b95-8a62-0a28600e86f5 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:34.530308 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b5ee7739-121e-4b95-8a62-0a28600e86f5 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:34.643520 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ea54c74a-bb74-4e58-a603-bd0095feec4b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.200177 Sep 26 05:29:34.644000 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 23/46] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Sep 26 05:29:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 3207 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 26 05:29:34.669767 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3b7d12f8-da88-40ef-92c1-16df826cf7a3 tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] Calling method '.version_select at 0x7fd7b76ab1f0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:34.853559 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3b7d12f8-da88-40ef-92c1-16df826cf7a3 tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2e2b2eef-a332-4407-9313-8935cfe954b3" status: 200 len: 351 microversion: 2.1 time: 0.208363 Sep 26 05:29:34.854136 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 24/47] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 05:29:34 2022] GET /compute/v2.1/os-volumes/2e2b2eef-a332-4407-9313-8935cfe954b3 => generated 351 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:34.859916 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d5a4ea5f-b0ff-4c54-a35c-99df5e92d78b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-186549767", "imageRef": "d37a4f3d-6311-48af-9e33-4c62c14cdd1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "542c3891-aa7c-4297-a50e-fe5b71cd3cf3"}], "security_groups": [{"name": "tempest-securitygroup--1550524029"}], "key_name": "tempest-keypair-245433757", "user_data": "}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:29:35.176500 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b5ee7739-121e-4b95-8a62-0a28600e86f5 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:35.191262 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b5ee7739-121e-4b95-8a62-0a28600e86f5 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.726669 Sep 26 05:29:35.203678 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 24/48] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:34 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:35.214264 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d1fe3c0a-2562-4eaa-9215-87598704b48f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:35.216219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d1fe3c0a-2562-4eaa-9215-87598704b48f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:35.326992 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-d5a4ea5f-b0ff-4c54-a35c-99df5e92d78b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] validate_networks() for [('542c3891-aa7c-4297-a50e-fe5b71cd3cf3', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:29:35.494920 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d1fe3c0a-2562-4eaa-9215-87598704b48f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:35.504309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d1fe3c0a-2562-4eaa-9215-87598704b48f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:35.507980 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d1fe3c0a-2562-4eaa-9215-87598704b48f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:35.512162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d1fe3c0a-2562-4eaa-9215-87598704b48f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1282 microversion: 2.20 time: 0.304956 Sep 26 05:29:35.516012 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 25/49] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:29:35 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1282 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:29:35.533188 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b6ee2119-84be-46dd-ab92-355b00ff2baa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:35.536396 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b6ee2119-84be-46dd-ab92-355b00ff2baa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:35.561821 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b6ee2119-84be-46dd-ab92-355b00ff2baa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:35.574004 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b6ee2119-84be-46dd-ab92-355b00ff2baa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:35.575751 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b6ee2119-84be-46dd-ab92-355b00ff2baa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:35.577193 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b6ee2119-84be-46dd-ab92-355b00ff2baa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:35.580274 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b6ee2119-84be-46dd-ab92-355b00ff2baa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:35.582855 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b6ee2119-84be-46dd-ab92-355b00ff2baa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:35.875982 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b6ee2119-84be-46dd-ab92-355b00ff2baa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:35.897536 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b6ee2119-84be-46dd-ab92-355b00ff2baa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1280 microversion: 2.1 time: 0.372872 Sep 26 05:29:35.901116 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 26/50] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:35 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1280 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:35.922654 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1b3f364f-32ca-43cd-be07-5226e4acfcae tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] Calling method '.version_select at 0x7fd7b76e7790>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:36.008213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-1b3f364f-32ca-43cd-be07-5226e4acfcae tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] HTTP exception thrown: Volume 2e2b2eef-a332-4407-9313-8935cfe954b3 could not be found. Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1b3f364f-32ca-43cd-be07-5226e4acfcae tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] Request method failure captured: Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/os-volumes/2e2b2eef-a332-4407-9313-8935cfe954b3 HTTP/1.1 Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTi4EyKx-Xh6OBlOyyXatUkejpATTAHtYgcEo72GNCpuUYrnVqemiM3kSADdMCxfQQtk8vVVMG3FyFisqrhgxNVCzlpqpW4ahSrDAWdkrmzElSBWU52qHMmDs_4GpzCLjVE9BHtXm86piwh1pCZBdJ8ZoYNnfZCB2f-JPWIYjtire-M Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: 21471e53ced347948470159d8ae56189 Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-VolumesGetTestJSON-1549045393 Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:29:36.013097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:29:36.014283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/21471e53ced347948470159d8ae56189"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/21471e53ced347948470159d8ae56189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/21471e53ced347948470159d8ae56189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_21471e53ced347948470159d8ae56189"}]}] Sep 26 05:29:36.014283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-VolumesGetTestJSON-1549045393 Sep 26 05:29:36.014283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: 21471e53ced347948470159d8ae56189 Sep 26 05:29:36.014283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-VolumesGetTestJSON-1549045393 Sep 26 05:29:36.014283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-VolumesGetTestJSON-1549045393-project Sep 26 05:29:36.014283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:29:36.014283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:29:36.014283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 58c65cf2ed3745e8bf17cb4440cd20dc Sep 26 05:29:36.014283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-VolumesGetTestJSON-1549045393-project Sep 26 05:29:36.014283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: Sep 26 05:29:36.014283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Volume 2e2b2eef-a332-4407-9313-8935cfe954b3 could not be found. Sep 26 05:29:36.014283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': '2e2b2eef-a332-4407-9313-8935cfe954b3'} Sep 26 05:29:36.014283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2e2b2eef-a332-4407-9313-8935cfe954b3 could not be found. (HTTP 404) (Request-ID: req-8ddb248f-94bc-4075-a59d-4e7c797c66d6) Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:29:36.015105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:29:36.016211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2e2b2eef-a332-4407-9313-8935cfe954b3 could not be found. Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 05:29:36.017200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:29:36.018138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2e2b2eef-a332-4407-9313-8935cfe954b3 could not be found. Sep 26 05:29:36.018138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:29:36.018138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:29:36.018138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:29:36.018138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:29:36.018138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:29:36.018138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:29:36.018138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:29:36.018138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:29:36.018138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2e2b2eef-a332-4407-9313-8935cfe954b3 could not be found. Sep 26 05:29:36.018138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:29:36.024428 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1b3f364f-32ca-43cd-be07-5226e4acfcae tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] Returning 404 to user: Volume 2e2b2eef-a332-4407-9313-8935cfe954b3 could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:29:36.027586 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1b3f364f-32ca-43cd-be07-5226e4acfcae tempest-VolumesGetTestJSON-1549045393 tempest-VolumesGetTestJSON-1549045393-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2e2b2eef-a332-4407-9313-8935cfe954b3" status: 404 len: 109 microversion: 2.1 time: 0.125190 Sep 26 05:29:36.034661 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 27/51] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 05:29:35 2022] GET /compute/v2.1/os-volumes/2e2b2eef-a332-4407-9313-8935cfe954b3 => generated 109 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:29:36.233697 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6085f2a9-c876-4b71-b8d0-19be91fc0d72 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:36.234638 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6085f2a9-c876-4b71-b8d0-19be91fc0d72 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:36.262891 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6085f2a9-c876-4b71-b8d0-19be91fc0d72 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:36.263757 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6085f2a9-c876-4b71-b8d0-19be91fc0d72 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:36.267065 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6085f2a9-c876-4b71-b8d0-19be91fc0d72 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:36.268078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6085f2a9-c876-4b71-b8d0-19be91fc0d72 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:36.268934 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6085f2a9-c876-4b71-b8d0-19be91fc0d72 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:36.269637 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6085f2a9-c876-4b71-b8d0-19be91fc0d72 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:36.967721 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-d5a4ea5f-b0ff-4c54-a35c-99df5e92d78b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:29:36.968925 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-d5a4ea5f-b0ff-4c54-a35c-99df5e92d78b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:29:36.970093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-d5a4ea5f-b0ff-4c54-a35c-99df5e92d78b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:29:36.970661 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-d5a4ea5f-b0ff-4c54-a35c-99df5e92d78b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:29:36.971361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-d5a4ea5f-b0ff-4c54-a35c-99df5e92d78b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:29:37.030522 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5a4ea5f-b0ff-4c54-a35c-99df5e92d78b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:37.033818 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5a4ea5f-b0ff-4c54-a35c-99df5e92d78b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:37.034310 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5a4ea5f-b0ff-4c54-a35c-99df5e92d78b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:37.035133 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5a4ea5f-b0ff-4c54-a35c-99df5e92d78b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:37.046352 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5a4ea5f-b0ff-4c54-a35c-99df5e92d78b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:37.046900 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5a4ea5f-b0ff-4c54-a35c-99df5e92d78b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:37.078875 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6085f2a9-c876-4b71-b8d0-19be91fc0d72 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:37.098653 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6085f2a9-c876-4b71-b8d0-19be91fc0d72 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.870671 Sep 26 05:29:37.101025 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 28/52] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:36 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:37.107474 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-53f6c1b7-6180-4bea-8454-855d960da170 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:37.108468 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-53f6c1b7-6180-4bea-8454-855d960da170 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:37.132645 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-53f6c1b7-6180-4bea-8454-855d960da170 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:37.133429 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-53f6c1b7-6180-4bea-8454-855d960da170 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:37.135305 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-53f6c1b7-6180-4bea-8454-855d960da170 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:37.137441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-53f6c1b7-6180-4bea-8454-855d960da170 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:37.140575 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-53f6c1b7-6180-4bea-8454-855d960da170 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:37.141805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-53f6c1b7-6180-4bea-8454-855d960da170 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:37.171854 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-d5a4ea5f-b0ff-4c54-a35c-99df5e92d78b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Getting quotas for project fd13dd8ec810435491e3f3cba7cca4d1. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:29:37.191979 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-d5a4ea5f-b0ff-4c54-a35c-99df5e92d78b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Getting quotas for user 48e588ff6d5a4a37b902abadfb6d04fc and project fd13dd8ec810435491e3f3cba7cca4d1. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:29:37.236940 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d5a4ea5f-b0ff-4c54-a35c-99df5e92d78b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:29:37.239345 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d5a4ea5f-b0ff-4c54-a35c-99df5e92d78b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d37a4f3d-6311-48af-9e33-4c62c14cdd1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:29:37.332040 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-53f6c1b7-6180-4bea-8454-855d960da170 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:37.353081 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-53f6c1b7-6180-4bea-8454-855d960da170 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:37.354780 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-53f6c1b7-6180-4bea-8454-855d960da170 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:37.356094 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-53f6c1b7-6180-4bea-8454-855d960da170 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1334 microversion: 2.20 time: 0.253812 Sep 26 05:29:37.365212 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:37.366395 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 29/53] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:29:37 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1334 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:29:37.383628 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-cc869cd9-2ab3-4bf4-9873-1ee1f9313a6b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:37.384293 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-cc869cd9-2ab3-4bf4-9873-1ee1f9313a6b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:37.416737 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cc869cd9-2ab3-4bf4-9873-1ee1f9313a6b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:37.417326 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cc869cd9-2ab3-4bf4-9873-1ee1f9313a6b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:37.417780 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cc869cd9-2ab3-4bf4-9873-1ee1f9313a6b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:37.418797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cc869cd9-2ab3-4bf4-9873-1ee1f9313a6b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:37.418981 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cc869cd9-2ab3-4bf4-9873-1ee1f9313a6b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:37.419392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cc869cd9-2ab3-4bf4-9873-1ee1f9313a6b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:37.449725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d5a4ea5f-b0ff-4c54-a35c-99df5e92d78b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.591292 Sep 26 05:29:37.450403 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 25/54] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:29:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 2596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:29:37.492035 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-19e7e968-254c-488d-864f-acaece902b3d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:37.500080 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-19e7e968-254c-488d-864f-acaece902b3d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:38.278684 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-cc869cd9-2ab3-4bf4-9873-1ee1f9313a6b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:38.289623 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-cc869cd9-2ab3-4bf4-9873-1ee1f9313a6b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1280 microversion: 2.1 time: 0.921913 Sep 26 05:29:38.312328 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 30/55] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:37 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1280 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:38.320457 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-19e7e968-254c-488d-864f-acaece902b3d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:38.336908 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-306fd410-06f3-4f93-88da-4da42c15a4d0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:38.338951 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-19e7e968-254c-488d-864f-acaece902b3d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1240 microversion: 2.1 time: 0.877745 Sep 26 05:29:38.345190 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 26/56] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:37 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1240 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:38.348518 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-306fd410-06f3-4f93-88da-4da42c15a4d0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:38.356431 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-306fd410-06f3-4f93-88da-4da42c15a4d0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:38.357291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-306fd410-06f3-4f93-88da-4da42c15a4d0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:38.358004 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-306fd410-06f3-4f93-88da-4da42c15a4d0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:38.359059 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-306fd410-06f3-4f93-88da-4da42c15a4d0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:38.360039 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-306fd410-06f3-4f93-88da-4da42c15a4d0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:38.374941 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-306fd410-06f3-4f93-88da-4da42c15a4d0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:38.423777 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f7b5abf4-f639-4108-baca-1b5d5945f515 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:38.424490 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f7b5abf4-f639-4108-baca-1b5d5945f515 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:38.451181 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7b5abf4-f639-4108-baca-1b5d5945f515 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:38.457522 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7b5abf4-f639-4108-baca-1b5d5945f515 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:38.457522 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7b5abf4-f639-4108-baca-1b5d5945f515 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:38.457522 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7b5abf4-f639-4108-baca-1b5d5945f515 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:38.472968 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7b5abf4-f639-4108-baca-1b5d5945f515 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:38.473924 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7b5abf4-f639-4108-baca-1b5d5945f515 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:38.893305 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f7b5abf4-f639-4108-baca-1b5d5945f515 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:38.923251 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f7b5abf4-f639-4108-baca-1b5d5945f515 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:38.924868 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f7b5abf4-f639-4108-baca-1b5d5945f515 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:38.929160 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f7b5abf4-f639-4108-baca-1b5d5945f515 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1340 microversion: 2.20 time: 0.523224 Sep 26 05:29:38.941743 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 27/57] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:29:38 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1340 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:29:39.094966 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-306fd410-06f3-4f93-88da-4da42c15a4d0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:39.103599 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-306fd410-06f3-4f93-88da-4da42c15a4d0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.789870 Sep 26 05:29:39.116116 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 31/58] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:38 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:39.320476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-22df9cd8-f7a5-436b-aa1b-b78b425828b4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:39.321486 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-22df9cd8-f7a5-436b-aa1b-b78b425828b4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:39.334597 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22df9cd8-f7a5-436b-aa1b-b78b425828b4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:39.335105 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22df9cd8-f7a5-436b-aa1b-b78b425828b4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:39.335935 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22df9cd8-f7a5-436b-aa1b-b78b425828b4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:39.336745 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22df9cd8-f7a5-436b-aa1b-b78b425828b4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:39.337191 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22df9cd8-f7a5-436b-aa1b-b78b425828b4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:39.338289 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22df9cd8-f7a5-436b-aa1b-b78b425828b4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:39.377425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-46de58c7-42c5-44d4-be5f-710cd31de0d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:39.378646 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-46de58c7-42c5-44d4-be5f-710cd31de0d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:39.390517 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-46de58c7-42c5-44d4-be5f-710cd31de0d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:39.393502 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-46de58c7-42c5-44d4-be5f-710cd31de0d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:39.394395 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-46de58c7-42c5-44d4-be5f-710cd31de0d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:39.395322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-46de58c7-42c5-44d4-be5f-710cd31de0d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:39.397020 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-46de58c7-42c5-44d4-be5f-710cd31de0d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:39.409921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-46de58c7-42c5-44d4-be5f-710cd31de0d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:39.463972 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-22df9cd8-f7a5-436b-aa1b-b78b425828b4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:39.490892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-22df9cd8-f7a5-436b-aa1b-b78b425828b4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1280 microversion: 2.1 time: 0.175550 Sep 26 05:29:39.495611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 28/59] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:39 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1280 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:39.624693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-46de58c7-42c5-44d4-be5f-710cd31de0d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:39.660680 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-46de58c7-42c5-44d4-be5f-710cd31de0d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1292 microversion: 2.1 time: 0.287153 Sep 26 05:29:39.666073 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 32/60] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:39 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1292 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:39.960085 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7772a3fd-8611-42ce-abc7-ff68572c3234 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:39.960798 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7772a3fd-8611-42ce-abc7-ff68572c3234 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:39.979141 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7772a3fd-8611-42ce-abc7-ff68572c3234 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:39.981300 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7772a3fd-8611-42ce-abc7-ff68572c3234 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:39.983528 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7772a3fd-8611-42ce-abc7-ff68572c3234 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:39.986298 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7772a3fd-8611-42ce-abc7-ff68572c3234 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:39.987061 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7772a3fd-8611-42ce-abc7-ff68572c3234 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:39.987901 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7772a3fd-8611-42ce-abc7-ff68572c3234 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:40.128945 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7772a3fd-8611-42ce-abc7-ff68572c3234 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:40.143423 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7772a3fd-8611-42ce-abc7-ff68572c3234 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:40.143796 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9007c1f1-4523-42ed-a773-0b267dd03eb0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:40.144518 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-9007c1f1-4523-42ed-a773-0b267dd03eb0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:40.146914 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7772a3fd-8611-42ce-abc7-ff68572c3234 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:40.150446 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7772a3fd-8611-42ce-abc7-ff68572c3234 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1340 microversion: 2.20 time: 0.194602 Sep 26 05:29:40.151748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 29/61] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:29:39 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1340 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:29:40.155777 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9007c1f1-4523-42ed-a773-0b267dd03eb0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:40.156316 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9007c1f1-4523-42ed-a773-0b267dd03eb0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:40.156898 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9007c1f1-4523-42ed-a773-0b267dd03eb0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:40.157551 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9007c1f1-4523-42ed-a773-0b267dd03eb0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:40.158180 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9007c1f1-4523-42ed-a773-0b267dd03eb0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:40.159009 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9007c1f1-4523-42ed-a773-0b267dd03eb0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:40.519238 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1a7691f2-14d0-4e6c-8121-367fcf001e67 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:40.519839 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1a7691f2-14d0-4e6c-8121-367fcf001e67 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:40.538750 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1a7691f2-14d0-4e6c-8121-367fcf001e67 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:40.541486 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1a7691f2-14d0-4e6c-8121-367fcf001e67 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:40.543450 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1a7691f2-14d0-4e6c-8121-367fcf001e67 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:40.548510 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1a7691f2-14d0-4e6c-8121-367fcf001e67 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:40.549988 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1a7691f2-14d0-4e6c-8121-367fcf001e67 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:40.550871 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1a7691f2-14d0-4e6c-8121-367fcf001e67 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:40.749274 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1a7691f2-14d0-4e6c-8121-367fcf001e67 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:40.762284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1a7691f2-14d0-4e6c-8121-367fcf001e67 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1280 microversion: 2.1 time: 0.247661 Sep 26 05:29:40.773645 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 30/62] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:40 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1280 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:40.791821 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-040bad94-fd5e-4e6f-9489-0e9b410b2b25 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:40.794589 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-040bad94-fd5e-4e6f-9489-0e9b410b2b25 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:40.808472 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-040bad94-fd5e-4e6f-9489-0e9b410b2b25 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:40.810733 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-040bad94-fd5e-4e6f-9489-0e9b410b2b25 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:40.815720 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-9007c1f1-4523-42ed-a773-0b267dd03eb0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:40.826404 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-040bad94-fd5e-4e6f-9489-0e9b410b2b25 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:40.827747 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-040bad94-fd5e-4e6f-9489-0e9b410b2b25 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:40.829996 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-040bad94-fd5e-4e6f-9489-0e9b410b2b25 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:40.831270 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-040bad94-fd5e-4e6f-9489-0e9b410b2b25 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:40.835682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-9007c1f1-4523-42ed-a773-0b267dd03eb0 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.694150 Sep 26 05:29:40.844594 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 33/63] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:40 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:41.092586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-040bad94-fd5e-4e6f-9489-0e9b410b2b25 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:41.117718 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-040bad94-fd5e-4e6f-9489-0e9b410b2b25 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1300 microversion: 2.1 time: 0.342686 Sep 26 05:29:41.121298 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 31/64] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:40 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1300 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:41.185417 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-4219c11b-cb8a-4fa7-9f86-014bc302f4de tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:41.187786 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-4219c11b-cb8a-4fa7-9f86-014bc302f4de tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:41.216698 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4219c11b-cb8a-4fa7-9f86-014bc302f4de tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:41.217569 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4219c11b-cb8a-4fa7-9f86-014bc302f4de tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:41.218172 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4219c11b-cb8a-4fa7-9f86-014bc302f4de tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:41.220115 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4219c11b-cb8a-4fa7-9f86-014bc302f4de tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:41.223209 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4219c11b-cb8a-4fa7-9f86-014bc302f4de tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:41.225069 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4219c11b-cb8a-4fa7-9f86-014bc302f4de tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:41.602071 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-4219c11b-cb8a-4fa7-9f86-014bc302f4de tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:41.621210 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-4219c11b-cb8a-4fa7-9f86-014bc302f4de tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:41.627231 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-4219c11b-cb8a-4fa7-9f86-014bc302f4de tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:41.632989 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-4219c11b-cb8a-4fa7-9f86-014bc302f4de tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1340 microversion: 2.20 time: 0.453813 Sep 26 05:29:41.634049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 34/65] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:29:41 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1340 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:29:41.793127 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f06e9f08-d046-46a9-91d0-15053acaf49c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:41.793963 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f06e9f08-d046-46a9-91d0-15053acaf49c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:41.814383 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f06e9f08-d046-46a9-91d0-15053acaf49c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:41.815652 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f06e9f08-d046-46a9-91d0-15053acaf49c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:41.817397 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f06e9f08-d046-46a9-91d0-15053acaf49c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:41.818960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f06e9f08-d046-46a9-91d0-15053acaf49c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:41.821141 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f06e9f08-d046-46a9-91d0-15053acaf49c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:41.826793 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f06e9f08-d046-46a9-91d0-15053acaf49c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:41.860407 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5d9da95b-053a-46e1-af9f-42c53ee3fd2f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:41.861783 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5d9da95b-053a-46e1-af9f-42c53ee3fd2f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:41.874493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5d9da95b-053a-46e1-af9f-42c53ee3fd2f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:41.879704 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5d9da95b-053a-46e1-af9f-42c53ee3fd2f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:41.881137 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5d9da95b-053a-46e1-af9f-42c53ee3fd2f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:41.886791 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5d9da95b-053a-46e1-af9f-42c53ee3fd2f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:41.889060 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5d9da95b-053a-46e1-af9f-42c53ee3fd2f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:41.889791 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5d9da95b-053a-46e1-af9f-42c53ee3fd2f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:42.009888 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f06e9f08-d046-46a9-91d0-15053acaf49c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:42.023455 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f06e9f08-d046-46a9-91d0-15053acaf49c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1280 microversion: 2.1 time: 0.233785 Sep 26 05:29:42.036881 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 32/66] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:41 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1280 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:29:42.167350 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-96dd537c-a9a3-40c0-8c0b-34fe5c2e5c3a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:42.168646 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-96dd537c-a9a3-40c0-8c0b-34fe5c2e5c3a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:42.186090 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-96dd537c-a9a3-40c0-8c0b-34fe5c2e5c3a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:42.191974 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-96dd537c-a9a3-40c0-8c0b-34fe5c2e5c3a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:42.192746 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-96dd537c-a9a3-40c0-8c0b-34fe5c2e5c3a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:42.194675 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-96dd537c-a9a3-40c0-8c0b-34fe5c2e5c3a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:42.195162 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-96dd537c-a9a3-40c0-8c0b-34fe5c2e5c3a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:42.195596 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-96dd537c-a9a3-40c0-8c0b-34fe5c2e5c3a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:42.488827 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5d9da95b-053a-46e1-af9f-42c53ee3fd2f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:42.497465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5d9da95b-053a-46e1-af9f-42c53ee3fd2f tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.642051 Sep 26 05:29:42.508440 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 35/67] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:41 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:29:42.538495 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-96dd537c-a9a3-40c0-8c0b-34fe5c2e5c3a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:42.555551 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-96dd537c-a9a3-40c0-8c0b-34fe5c2e5c3a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1298 microversion: 2.1 time: 0.392274 Sep 26 05:29:42.560706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 33/68] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:42 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1298 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:42.672005 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-de838b70-0751-4383-863d-7d51eedc995a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:42.676778 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-de838b70-0751-4383-863d-7d51eedc995a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:42.704049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de838b70-0751-4383-863d-7d51eedc995a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:42.704821 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de838b70-0751-4383-863d-7d51eedc995a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:42.709369 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de838b70-0751-4383-863d-7d51eedc995a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:42.712618 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de838b70-0751-4383-863d-7d51eedc995a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:42.714944 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de838b70-0751-4383-863d-7d51eedc995a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:42.715621 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de838b70-0751-4383-863d-7d51eedc995a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:43.035856 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-de838b70-0751-4383-863d-7d51eedc995a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:43.047056 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-de838b70-0751-4383-863d-7d51eedc995a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:43.051292 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-de838b70-0751-4383-863d-7d51eedc995a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:43.056655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-de838b70-0751-4383-863d-7d51eedc995a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1340 microversion: 2.20 time: 0.394215 Sep 26 05:29:43.057676 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-59359a0f-ed02-4027-aaf1-7303f98a4d2f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:43.058419 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-59359a0f-ed02-4027-aaf1-7303f98a4d2f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:43.060310 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 36/69] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:29:42 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1340 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:29:43.071159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59359a0f-ed02-4027-aaf1-7303f98a4d2f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:43.072616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59359a0f-ed02-4027-aaf1-7303f98a4d2f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:43.076900 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59359a0f-ed02-4027-aaf1-7303f98a4d2f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:43.080937 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59359a0f-ed02-4027-aaf1-7303f98a4d2f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:43.084355 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59359a0f-ed02-4027-aaf1-7303f98a4d2f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:43.089552 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59359a0f-ed02-4027-aaf1-7303f98a4d2f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:43.478377 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-616c85a1-3843-410f-b54f-9fee70613999 req-905ec5e9-6ad0-4ece-a7c3-ca0d649caec6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a31a978e-d8fb-4412-ad8c-999a3f18cfce", "tag": "700f3c7c-ee4f-426b-9bf3-1e03b2102f81"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:29:43.549946 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-616c85a1-3843-410f-b54f-9fee70613999 req-905ec5e9-6ad0-4ece-a7c3-ca0d649caec6 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:43.550942 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-616c85a1-3843-410f-b54f-9fee70613999 req-905ec5e9-6ad0-4ece-a7c3-ca0d649caec6 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:43.551390 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-616c85a1-3843-410f-b54f-9fee70613999 req-905ec5e9-6ad0-4ece-a7c3-ca0d649caec6 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:43.642836 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-616c85a1-3843-410f-b54f-9fee70613999 req-905ec5e9-6ad0-4ece-a7c3-ca0d649caec6 service nova] Creating event network-changed:700f3c7c-ee4f-426b-9bf3-1e03b2102f81 for instance a31a978e-d8fb-4412-ad8c-999a3f18cfce on hv-cinder-85918 Sep 26 05:29:43.643380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-616c85a1-3843-410f-b54f-9fee70613999 req-905ec5e9-6ad0-4ece-a7c3-ca0d649caec6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120806) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 26 05:29:43.643770 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-616c85a1-3843-410f-b54f-9fee70613999 req-905ec5e9-6ad0-4ece-a7c3-ca0d649caec6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120806) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 26 05:29:43.651751 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2976ae52-f636-49bd-b196-557eb5e0f548 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:43.652280 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2976ae52-f636-49bd-b196-557eb5e0f548 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:43.652715 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2976ae52-f636-49bd-b196-557eb5e0f548 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:43.653455 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2976ae52-f636-49bd-b196-557eb5e0f548 None None] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:43.653915 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2976ae52-f636-49bd-b196-557eb5e0f548 None None] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:43.654334 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2976ae52-f636-49bd-b196-557eb5e0f548 None None] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:43.707680 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.compute.rpcapi [None req-2976ae52-f636-49bd-b196-557eb5e0f548 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 26 05:29:43.712458 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2976ae52-f636-49bd-b196-557eb5e0f548 None None] Releasing lock "compute-rpcapi-router" {{(pid=120806) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 26 05:29:43.726299 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-59359a0f-ed02-4027-aaf1-7303f98a4d2f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:43.732668 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2976ae52-f636-49bd-b196-557eb5e0f548 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.440269 Sep 26 05:29:43.736405 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 37/70] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:43.743225 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-59359a0f-ed02-4027-aaf1-7303f98a4d2f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1322 microversion: 2.1 time: 0.691955 Sep 26 05:29:43.753327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-476599ef-be8f-4a77-be2c-6116eb082f42 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:43.754543 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-476599ef-be8f-4a77-be2c-6116eb082f42 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:43.758234 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 34/71] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:43 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1322 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:29:43.769102 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-476599ef-be8f-4a77-be2c-6116eb082f42 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:43.772630 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8aba82f7-8d37-4033-ba1c-a5e32a8a31dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:43.772832 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-476599ef-be8f-4a77-be2c-6116eb082f42 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:43.773260 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8aba82f7-8d37-4033-ba1c-a5e32a8a31dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:43.774676 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-476599ef-be8f-4a77-be2c-6116eb082f42 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:43.776988 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-476599ef-be8f-4a77-be2c-6116eb082f42 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:43.778749 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-476599ef-be8f-4a77-be2c-6116eb082f42 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:43.780634 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-476599ef-be8f-4a77-be2c-6116eb082f42 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:43.793945 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8aba82f7-8d37-4033-ba1c-a5e32a8a31dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:43.795064 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8aba82f7-8d37-4033-ba1c-a5e32a8a31dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:43.795754 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8aba82f7-8d37-4033-ba1c-a5e32a8a31dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:43.800398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8aba82f7-8d37-4033-ba1c-a5e32a8a31dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:43.804563 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8aba82f7-8d37-4033-ba1c-a5e32a8a31dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:43.804563 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8aba82f7-8d37-4033-ba1c-a5e32a8a31dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:43.873937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=100 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:44.508431 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-476599ef-be8f-4a77-be2c-6116eb082f42 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:44.517096 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-476599ef-be8f-4a77-be2c-6116eb082f42 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.776829 Sep 26 05:29:44.517250 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8aba82f7-8d37-4033-ba1c-a5e32a8a31dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:44.532276 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8aba82f7-8d37-4033-ba1c-a5e32a8a31dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1366 microversion: 2.1 time: 0.759696 Sep 26 05:29:44.532276 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 35/72] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:43 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1366 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:44.532276 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2dd9736b-7b32-4410-b0cf-973cde04913f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:44.532605 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2dd9736b-7b32-4410-b0cf-973cde04913f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:44.533682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 38/73] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:43 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:44.539750 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-8ee43378-2c52-4dfa-aa29-4017e6ff23e5 tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] Calling method '.version_select at 0x7fd7b76e71f0>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:44.541302 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2dd9736b-7b32-4410-b0cf-973cde04913f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:44.541815 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2dd9736b-7b32-4410-b0cf-973cde04913f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:44.542890 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2dd9736b-7b32-4410-b0cf-973cde04913f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:44.543608 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2dd9736b-7b32-4410-b0cf-973cde04913f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:44.544189 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2dd9736b-7b32-4410-b0cf-973cde04913f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:44.544649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2dd9736b-7b32-4410-b0cf-973cde04913f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:44.595805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-8ee43378-2c52-4dfa-aa29-4017e6ff23e5 tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3b2ec781-652d-4fba-b57c-62ae400d716b" status: 200 len: 351 microversion: 2.1 time: 0.060768 Sep 26 05:29:44.596980 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 39/74] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 05:29:44 2022] GET /compute/v2.1/os-volumes/3b2ec781-652d-4fba-b57c-62ae400d716b => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:44.772784 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-ba0facef-02ee-401d-b505-f8126d985043 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:44.773763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-ba0facef-02ee-401d-b505-f8126d985043 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:44.785268 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ba0facef-02ee-401d-b505-f8126d985043 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:44.787394 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ba0facef-02ee-401d-b505-f8126d985043 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:44.790544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ba0facef-02ee-401d-b505-f8126d985043 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:44.791956 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ba0facef-02ee-401d-b505-f8126d985043 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:44.792643 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ba0facef-02ee-401d-b505-f8126d985043 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:44.793246 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ba0facef-02ee-401d-b505-f8126d985043 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:45.116476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2dd9736b-7b32-4410-b0cf-973cde04913f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:45.133452 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2dd9736b-7b32-4410-b0cf-973cde04913f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:45.135888 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2dd9736b-7b32-4410-b0cf-973cde04913f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:45.137579 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2dd9736b-7b32-4410-b0cf-973cde04913f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1407 microversion: 2.20 time: 0.609354 Sep 26 05:29:45.139065 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 36/75] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:29:44 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1407 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:29:45.197956 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-ba0facef-02ee-401d-b505-f8126d985043 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:45.210974 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-ba0facef-02ee-401d-b505-f8126d985043 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1322 microversion: 2.1 time: 0.442816 Sep 26 05:29:45.220706 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 40/76] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:44 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1322 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:45.549014 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fe1f10e5-ac5f-4ccd-8dc2-d90e5725c5fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:45.550228 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fe1f10e5-ac5f-4ccd-8dc2-d90e5725c5fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:45.558898 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-351abe0e-6efc-45b9-b807-736ee55db16a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:45.559508 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-351abe0e-6efc-45b9-b807-736ee55db16a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:45.560689 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe1f10e5-ac5f-4ccd-8dc2-d90e5725c5fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:45.561362 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe1f10e5-ac5f-4ccd-8dc2-d90e5725c5fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:45.561476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=16 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:45.562937 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe1f10e5-ac5f-4ccd-8dc2-d90e5725c5fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:45.569657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe1f10e5-ac5f-4ccd-8dc2-d90e5725c5fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:45.570441 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe1f10e5-ac5f-4ccd-8dc2-d90e5725c5fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:45.571464 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe1f10e5-ac5f-4ccd-8dc2-d90e5725c5fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:45.576584 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-351abe0e-6efc-45b9-b807-736ee55db16a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:45.577084 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-351abe0e-6efc-45b9-b807-736ee55db16a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:45.577515 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-351abe0e-6efc-45b9-b807-736ee55db16a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:45.578285 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-351abe0e-6efc-45b9-b807-736ee55db16a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:45.578991 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-351abe0e-6efc-45b9-b807-736ee55db16a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:45.579720 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-351abe0e-6efc-45b9-b807-736ee55db16a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:46.057117 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fe1f10e5-ac5f-4ccd-8dc2-d90e5725c5fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:46.070373 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fe1f10e5-ac5f-4ccd-8dc2-d90e5725c5fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.528626 Sep 26 05:29:46.070833 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-351abe0e-6efc-45b9-b807-736ee55db16a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:46.071928 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 37/77] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:45 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:46.079460 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-b8c55c3f-e0e9-4a56-b547-c1e26a280b75 req-8e3f787b-bd81-41bc-abad-ecce3c524b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01274a67-17fb-45e3-9f2a-6a718b15b902", "tag": "f70e6461-7f87-4ee4-b3e4-f7d4db390598"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:29:46.081192 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-351abe0e-6efc-45b9-b807-736ee55db16a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1366 microversion: 2.1 time: 0.525979 Sep 26 05:29:46.081771 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 41/78] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:45 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1366 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:29:46.099427 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-b8c55c3f-e0e9-4a56-b547-c1e26a280b75 req-8e3f787b-bd81-41bc-abad-ecce3c524b0c service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:46.100588 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-b8c55c3f-e0e9-4a56-b547-c1e26a280b75 req-8e3f787b-bd81-41bc-abad-ecce3c524b0c service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:46.100707 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-b8c55c3f-e0e9-4a56-b547-c1e26a280b75 req-8e3f787b-bd81-41bc-abad-ecce3c524b0c service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:46.146531 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-62d172de-0f29-4c8f-9254-e7a48fe29af2 tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] Calling method '.version_select at 0x7fd7b769f310>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:46.151996 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:46.174761 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-b8c55c3f-e0e9-4a56-b547-c1e26a280b75 req-8e3f787b-bd81-41bc-abad-ecce3c524b0c service nova] Creating event network-changed:f70e6461-7f87-4ee4-b3e4-f7d4db390598 for instance 01274a67-17fb-45e3-9f2a-6a718b15b902 on hv-cinder-85918 Sep 26 05:29:46.175374 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-b8c55c3f-e0e9-4a56-b547-c1e26a280b75 req-8e3f787b-bd81-41bc-abad-ecce3c524b0c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120805) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 26 05:29:46.176016 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-b8c55c3f-e0e9-4a56-b547-c1e26a280b75 req-8e3f787b-bd81-41bc-abad-ecce3c524b0c service nova] Acquired lock "compute-rpcapi-router" {{(pid=120805) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 26 05:29:46.178044 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6b58e5c8-2055-4c42-be80-2b1452177556 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:46.178702 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6b58e5c8-2055-4c42-be80-2b1452177556 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:46.179320 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6b58e5c8-2055-4c42-be80-2b1452177556 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:46.180339 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6b58e5c8-2055-4c42-be80-2b1452177556 None None] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:46.181510 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6b58e5c8-2055-4c42-be80-2b1452177556 None None] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:46.182188 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6b58e5c8-2055-4c42-be80-2b1452177556 None None] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:46.196219 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.compute.rpcapi [None req-6b58e5c8-2055-4c42-be80-2b1452177556 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 26 05:29:46.198023 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6b58e5c8-2055-4c42-be80-2b1452177556 None None] Releasing lock "compute-rpcapi-router" {{(pid=120805) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 26 05:29:46.226862 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6b58e5c8-2055-4c42-be80-2b1452177556 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153242 Sep 26 05:29:46.231175 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 38/79] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:46.242471 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cceecec6-b513-41d6-8e2c-c75c3b94dc3d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:46.243515 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cceecec6-b513-41d6-8e2c-c75c3b94dc3d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:46.258040 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cceecec6-b513-41d6-8e2c-c75c3b94dc3d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:46.258857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cceecec6-b513-41d6-8e2c-c75c3b94dc3d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:46.259830 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cceecec6-b513-41d6-8e2c-c75c3b94dc3d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:46.261208 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cceecec6-b513-41d6-8e2c-c75c3b94dc3d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:46.263015 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cceecec6-b513-41d6-8e2c-c75c3b94dc3d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:46.263757 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cceecec6-b513-41d6-8e2c-c75c3b94dc3d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:46.292814 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-62d172de-0f29-4c8f-9254-e7a48fe29af2 tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/a533c7a5-97b0-4327-aa21-94c076411ef8" status: 200 len: 351 microversion: 2.1 time: 0.151131 Sep 26 05:29:46.294064 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 42/80] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 05:29:46 2022] GET /compute/v2.1/os-volumes/a533c7a5-97b0-4327-aa21-94c076411ef8 => generated 351 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:46.306500 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6aba2e73-f2b0-46ef-9eaf-b357475624f5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:46.307419 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6aba2e73-f2b0-46ef-9eaf-b357475624f5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:46.316704 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6aba2e73-f2b0-46ef-9eaf-b357475624f5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:46.317988 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6aba2e73-f2b0-46ef-9eaf-b357475624f5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:46.319573 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6aba2e73-f2b0-46ef-9eaf-b357475624f5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:46.321025 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6aba2e73-f2b0-46ef-9eaf-b357475624f5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:46.322446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6aba2e73-f2b0-46ef-9eaf-b357475624f5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:46.323133 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6aba2e73-f2b0-46ef-9eaf-b357475624f5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:46.675270 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cceecec6-b513-41d6-8e2c-c75c3b94dc3d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:46.695552 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cceecec6-b513-41d6-8e2c-c75c3b94dc3d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:46.696990 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cceecec6-b513-41d6-8e2c-c75c3b94dc3d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:46.698138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cceecec6-b513-41d6-8e2c-c75c3b94dc3d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1407 microversion: 2.20 time: 0.465458 Sep 26 05:29:46.699016 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 39/81] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:29:46 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1407 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:29:46.715368 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6aba2e73-f2b0-46ef-9eaf-b357475624f5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:46.733940 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6aba2e73-f2b0-46ef-9eaf-b357475624f5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1322 microversion: 2.1 time: 0.438182 Sep 26 05:29:46.734779 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 43/82] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:46 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:46.833462 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-bc500dd2-cf5e-46b8-ac78-c65234ddc384 req-f532d00f-a536-4d4c-bc32-ed73f67f2994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149e1a24-0c3f-4697-8982-771b7bbb4215", "tag": "61f405ec-53a2-45d3-97e1-b2c513f8244a"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:29:46.853942 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-bc500dd2-cf5e-46b8-ac78-c65234ddc384 req-f532d00f-a536-4d4c-bc32-ed73f67f2994 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:46.854439 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-bc500dd2-cf5e-46b8-ac78-c65234ddc384 req-f532d00f-a536-4d4c-bc32-ed73f67f2994 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:46.854923 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-bc500dd2-cf5e-46b8-ac78-c65234ddc384 req-f532d00f-a536-4d4c-bc32-ed73f67f2994 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:46.869098 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-bc500dd2-cf5e-46b8-ac78-c65234ddc384 req-f532d00f-a536-4d4c-bc32-ed73f67f2994 service nova] Creating event network-changed:61f405ec-53a2-45d3-97e1-b2c513f8244a for instance 149e1a24-0c3f-4697-8982-771b7bbb4215 on hv-cinder-85918 Sep 26 05:29:46.896947 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-bc500dd2-cf5e-46b8-ac78-c65234ddc384 req-f532d00f-a536-4d4c-bc32-ed73f67f2994 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196573 Sep 26 05:29:46.902665 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 40/83] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:47.103867 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-8e210028-5532-462c-b6e1-472c9f4278a9 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:47.104805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-8e210028-5532-462c-b6e1-472c9f4278a9 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:47.111576 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-977ab18a-ca7a-4557-8799-25784b2a434a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:47.112954 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-977ab18a-ca7a-4557-8799-25784b2a434a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:47.117471 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8e210028-5532-462c-b6e1-472c9f4278a9 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:47.118051 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8e210028-5532-462c-b6e1-472c9f4278a9 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:47.118553 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8e210028-5532-462c-b6e1-472c9f4278a9 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:47.119378 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8e210028-5532-462c-b6e1-472c9f4278a9 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:47.119898 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8e210028-5532-462c-b6e1-472c9f4278a9 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:47.120434 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8e210028-5532-462c-b6e1-472c9f4278a9 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:47.125536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-977ab18a-ca7a-4557-8799-25784b2a434a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:47.128936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-977ab18a-ca7a-4557-8799-25784b2a434a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:47.129427 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-977ab18a-ca7a-4557-8799-25784b2a434a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:47.131398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-977ab18a-ca7a-4557-8799-25784b2a434a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:47.131885 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-977ab18a-ca7a-4557-8799-25784b2a434a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:47.136495 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-977ab18a-ca7a-4557-8799-25784b2a434a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:47.507631 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8e210028-5532-462c-b6e1-472c9f4278a9 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:47.520432 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-8e210028-5532-462c-b6e1-472c9f4278a9 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.426416 Sep 26 05:29:47.529993 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 44/84] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:47 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:47.582597 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-977ab18a-ca7a-4557-8799-25784b2a434a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:47.591443 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-977ab18a-ca7a-4557-8799-25784b2a434a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1366 microversion: 2.1 time: 0.486363 Sep 26 05:29:47.605144 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 41/85] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:47 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1366 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:47.727326 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-fb9ed2fe-5512-4661-b54d-878cfc832a2e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:47.727946 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-fb9ed2fe-5512-4661-b54d-878cfc832a2e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:47.735409 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fb9ed2fe-5512-4661-b54d-878cfc832a2e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:47.751972 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fb9ed2fe-5512-4661-b54d-878cfc832a2e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:47.752567 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fb9ed2fe-5512-4661-b54d-878cfc832a2e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:47.753328 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fb9ed2fe-5512-4661-b54d-878cfc832a2e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:47.753800 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fb9ed2fe-5512-4661-b54d-878cfc832a2e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:47.754298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fb9ed2fe-5512-4661-b54d-878cfc832a2e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:47.771147 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f0fa7bbe-23a6-46c3-8d42-f8d8a2bb16d2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:47.771815 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f0fa7bbe-23a6-46c3-8d42-f8d8a2bb16d2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:47.781322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0fa7bbe-23a6-46c3-8d42-f8d8a2bb16d2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:47.784121 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0fa7bbe-23a6-46c3-8d42-f8d8a2bb16d2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:47.784695 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0fa7bbe-23a6-46c3-8d42-f8d8a2bb16d2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:47.788862 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0fa7bbe-23a6-46c3-8d42-f8d8a2bb16d2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:47.789346 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0fa7bbe-23a6-46c3-8d42-f8d8a2bb16d2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:47.793063 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0fa7bbe-23a6-46c3-8d42-f8d8a2bb16d2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:48.325753 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=36 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:48.369923 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-fb9ed2fe-5512-4661-b54d-878cfc832a2e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:48.372313 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f0fa7bbe-23a6-46c3-8d42-f8d8a2bb16d2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:48.381269 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-fb9ed2fe-5512-4661-b54d-878cfc832a2e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:48.382492 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f0fa7bbe-23a6-46c3-8d42-f8d8a2bb16d2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1322 microversion: 2.1 time: 0.616145 Sep 26 05:29:48.384197 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-fb9ed2fe-5512-4661-b54d-878cfc832a2e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:48.385783 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-fb9ed2fe-5512-4661-b54d-878cfc832a2e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1407 microversion: 2.20 time: 0.662663 Sep 26 05:29:48.386888 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 45/86] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:29:47 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1407 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:29:48.394911 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-93ca262d-d587-4d01-9db8-c81d982d1c68 tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] Calling method '.version_select at 0x7fd7b7754310>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:48.396810 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 42/87] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:47 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1322 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:48.409242 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-06190038-af98-4aa3-895c-8c8333a06045 req-5036e407-b8d1-46e1-8be2-36739682c7e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6937727-fb89-499b-91ea-fa6b399607f7", "tag": "38b128ed-e00f-4c9c-93fb-be3a153d50bf"}, {"name": "network-changed", "server_uuid": "6ffa337e-39e1-4edc-9a0d-4468ff05c577", "tag": "db14dfec-952b-46e2-9617-72801c005bb3"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:29:48.420374 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-06190038-af98-4aa3-895c-8c8333a06045 req-5036e407-b8d1-46e1-8be2-36739682c7e5 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:48.421039 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-06190038-af98-4aa3-895c-8c8333a06045 req-5036e407-b8d1-46e1-8be2-36739682c7e5 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:48.421460 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-06190038-af98-4aa3-895c-8c8333a06045 req-5036e407-b8d1-46e1-8be2-36739682c7e5 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:48.436582 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-06190038-af98-4aa3-895c-8c8333a06045 req-5036e407-b8d1-46e1-8be2-36739682c7e5 service nova] Creating event network-changed:38b128ed-e00f-4c9c-93fb-be3a153d50bf for instance e6937727-fb89-499b-91ea-fa6b399607f7 on hv-cinder-85918 Sep 26 05:29:48.437086 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-06190038-af98-4aa3-895c-8c8333a06045 req-5036e407-b8d1-46e1-8be2-36739682c7e5 service nova] Creating event network-changed:db14dfec-952b-46e2-9617-72801c005bb3 for instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 on hv-cinder-85918 Sep 26 05:29:48.443318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-06190038-af98-4aa3-895c-8c8333a06045 req-5036e407-b8d1-46e1-8be2-36739682c7e5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045053 Sep 26 05:29:48.447381 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 43/88] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:48.457441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-93ca262d-d587-4d01-9db8-c81d982d1c68 tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/26a8d352-8396-402b-b100-61874a54edae" status: 200 len: 351 microversion: 2.1 time: 0.067663 Sep 26 05:29:48.458816 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 46/89] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 05:29:48 2022] GET /compute/v2.1/os-volumes/26a8d352-8396-402b-b100-61874a54edae => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:48.472844 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-97f1426d-d355-4306-84ae-b645c6613775 tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] Calling method '.version_select at 0x7fd7b76ab820>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:48.544337 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-19db1587-4557-445e-9fc4-fc3f7c5e3e93 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:48.544958 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-19db1587-4557-445e-9fc4-fc3f7c5e3e93 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:48.553533 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-19db1587-4557-445e-9fc4-fc3f7c5e3e93 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:48.554325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-19db1587-4557-445e-9fc4-fc3f7c5e3e93 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:48.554923 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-19db1587-4557-445e-9fc4-fc3f7c5e3e93 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:48.555626 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-19db1587-4557-445e-9fc4-fc3f7c5e3e93 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:48.556073 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-19db1587-4557-445e-9fc4-fc3f7c5e3e93 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:48.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-19db1587-4557-445e-9fc4-fc3f7c5e3e93 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:48.564872 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-97f1426d-d355-4306-84ae-b645c6613775 tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.096368 Sep 26 05:29:48.565434 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 44/90] 10.222.0.49 () {58 vars in 1134 bytes} [Mon Sep 26 05:29:48 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:48.584003 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-61527005-9ff4-4564-b502-ebcc2dca23da tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] Calling method '.version_select at 0x7fd7b76aa8b0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:48.679880 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-61527005-9ff4-4564-b502-ebcc2dca23da tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.101570 Sep 26 05:29:48.681142 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 45/91] 10.222.0.49 () {58 vars in 1149 bytes} [Mon Sep 26 05:29:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:29:48.686304 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4f87d0b9-42bc-4e72-9a1b-c410109efa27 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:48.687186 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4f87d0b9-42bc-4e72-9a1b-c410109efa27 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:48.700600 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4f87d0b9-42bc-4e72-9a1b-c410109efa27 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:48.701724 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4f87d0b9-42bc-4e72-9a1b-c410109efa27 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:48.702399 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4f87d0b9-42bc-4e72-9a1b-c410109efa27 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:48.703894 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4f87d0b9-42bc-4e72-9a1b-c410109efa27 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:48.704643 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4f87d0b9-42bc-4e72-9a1b-c410109efa27 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:48.705813 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4f87d0b9-42bc-4e72-9a1b-c410109efa27 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:48.813811 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-19db1587-4557-445e-9fc4-fc3f7c5e3e93 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:48.824528 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-19db1587-4557-445e-9fc4-fc3f7c5e3e93 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.281804 Sep 26 05:29:48.826391 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 47/92] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:48 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:29:48.840789 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-bf843d25-d669-4470-afde-dabff1317b5b tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] Calling method '.version_select at 0x7fd7b769f700>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:48.981933 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-bf843d25-d669-4470-afde-dabff1317b5b tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.154315 Sep 26 05:29:48.982683 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 48/93] 10.222.0.49 () {58 vars in 1134 bytes} [Mon Sep 26 05:29:48 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:48.998116 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-528e7868-4be3-4b6a-aa4b-66c3bd03ec01 tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] Calling method '.version_select at 0x7fd7b77548b0>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:49.089226 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4f87d0b9-42bc-4e72-9a1b-c410109efa27 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:49.099687 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4f87d0b9-42bc-4e72-9a1b-c410109efa27 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1366 microversion: 2.1 time: 0.416202 Sep 26 05:29:49.100665 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 46/94] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:48 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1366 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:49.116626 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-528e7868-4be3-4b6a-aa4b-66c3bd03ec01 tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.123488 Sep 26 05:29:49.118868 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 49/95] 10.222.0.49 () {58 vars in 1167 bytes} [Mon Sep 26 05:29:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:29:49.134365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1af5e666-b364-4547-aec0-4cab83f792b3 tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] Calling method '.version_select at 0x7fd7b766c3a0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:49.306401 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1af5e666-b364-4547-aec0-4cab83f792b3 tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.176843 Sep 26 05:29:49.324847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-06947e68-f282-44db-a783-be180b2e83dc tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] Calling method '.version_select at 0x7fd7b7754550>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:49.325416 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 47/96] 10.222.0.49 () {58 vars in 1170 bytes} [Mon Sep 26 05:29:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:49.418255 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-891688c0-c1ff-4d3e-8188-7b3d1134568b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:49.418857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-891688c0-c1ff-4d3e-8188-7b3d1134568b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:49.430149 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-891688c0-c1ff-4d3e-8188-7b3d1134568b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:49.430650 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-891688c0-c1ff-4d3e-8188-7b3d1134568b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:49.431081 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-891688c0-c1ff-4d3e-8188-7b3d1134568b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:49.431786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-891688c0-c1ff-4d3e-8188-7b3d1134568b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:49.432235 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-891688c0-c1ff-4d3e-8188-7b3d1134568b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:49.453126 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-891688c0-c1ff-4d3e-8188-7b3d1134568b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:49.555567 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-06947e68-f282-44db-a783-be180b2e83dc tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.235513 Sep 26 05:29:49.565467 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 50/97] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Sep 26 05:29:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:49.571576 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-762e2a32-e86a-433c-a61e-e1e13869a0bb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:49.573030 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-762e2a32-e86a-433c-a61e-e1e13869a0bb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:49.577409 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:49.585141 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-762e2a32-e86a-433c-a61e-e1e13869a0bb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:49.585647 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-762e2a32-e86a-433c-a61e-e1e13869a0bb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:49.586621 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-762e2a32-e86a-433c-a61e-e1e13869a0bb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:49.587497 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-762e2a32-e86a-433c-a61e-e1e13869a0bb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:49.587851 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-762e2a32-e86a-433c-a61e-e1e13869a0bb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:49.588358 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-762e2a32-e86a-433c-a61e-e1e13869a0bb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:49.907018 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-762e2a32-e86a-433c-a61e-e1e13869a0bb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:49.909997 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-891688c0-c1ff-4d3e-8188-7b3d1134568b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:49.919037 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-762e2a32-e86a-433c-a61e-e1e13869a0bb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1322 microversion: 2.1 time: 0.352074 Sep 26 05:29:49.924611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-891688c0-c1ff-4d3e-8188-7b3d1134568b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:49.934614 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-891688c0-c1ff-4d3e-8188-7b3d1134568b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:49.936114 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-891688c0-c1ff-4d3e-8188-7b3d1134568b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1407 microversion: 2.20 time: 0.525057 Sep 26 05:29:49.938173 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 51/99] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:49 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:49.938319 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 48/98] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:29:49 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1407 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:29:49.944125 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f29379bd-1a62-4268-b237-3bf866ae432e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:49.944294 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-38881566-86ee-4ac6-956a-a3ab80aa4a91 tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] Calling method '.version_select at 0x7fd7b77540d0>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:49.945097 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f29379bd-1a62-4268-b237-3bf866ae432e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:49.953528 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f29379bd-1a62-4268-b237-3bf866ae432e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:49.955382 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f29379bd-1a62-4268-b237-3bf866ae432e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:49.956998 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f29379bd-1a62-4268-b237-3bf866ae432e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:49.959127 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f29379bd-1a62-4268-b237-3bf866ae432e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:49.960295 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f29379bd-1a62-4268-b237-3bf866ae432e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:49.961084 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f29379bd-1a62-4268-b237-3bf866ae432e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:50.072907 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-38881566-86ee-4ac6-956a-a3ab80aa4a91 tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.133386 Sep 26 05:29:50.073942 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 52/100] 10.222.0.49 () {58 vars in 1188 bytes} [Mon Sep 26 05:29:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:50.087320 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1a6bc58f-9edd-4c0b-b258-4d2d26cde296 tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] Calling method '.version_select at 0x7fd7b76e7310>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:50.207855 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1a6bc58f-9edd-4c0b-b258-4d2d26cde296 tempest-VolumesTestJSON-1914644197 tempest-VolumesTestJSON-1914644197-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.124505 Sep 26 05:29:50.208467 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 53/101] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Sep 26 05:29:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:50.213876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-627744c6-8acb-48bc-82ee-ceb855dc69ba tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:50.214663 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-627744c6-8acb-48bc-82ee-ceb855dc69ba tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:50.223196 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-627744c6-8acb-48bc-82ee-ceb855dc69ba tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:50.224373 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-627744c6-8acb-48bc-82ee-ceb855dc69ba tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:50.225006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-627744c6-8acb-48bc-82ee-ceb855dc69ba tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:50.226054 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-627744c6-8acb-48bc-82ee-ceb855dc69ba tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:50.226759 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-627744c6-8acb-48bc-82ee-ceb855dc69ba tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:50.227338 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-627744c6-8acb-48bc-82ee-ceb855dc69ba tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:50.236280 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f29379bd-1a62-4268-b237-3bf866ae432e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:50.251436 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f29379bd-1a62-4268-b237-3bf866ae432e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.307468 Sep 26 05:29:50.251967 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 49/102] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:49 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:50.402666 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-627744c6-8acb-48bc-82ee-ceb855dc69ba tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:50.410462 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-627744c6-8acb-48bc-82ee-ceb855dc69ba tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1366 microversion: 2.1 time: 0.200711 Sep 26 05:29:50.411953 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 54/103] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:50 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:50.687988 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-77b2c4b9-eed9-4ef1-b42c-23fab5406d3e req-56b570e2-4a46-4aea-817c-78f8b2ae813d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a31a978e-d8fb-4412-ad8c-999a3f18cfce", "name": "network-vif-plugged", "status": "completed", "tag": "700f3c7c-ee4f-426b-9bf3-1e03b2102f81"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:29:50.697763 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-77b2c4b9-eed9-4ef1-b42c-23fab5406d3e req-56b570e2-4a46-4aea-817c-78f8b2ae813d service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:50.698532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-77b2c4b9-eed9-4ef1-b42c-23fab5406d3e req-56b570e2-4a46-4aea-817c-78f8b2ae813d service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:50.698954 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-77b2c4b9-eed9-4ef1-b42c-23fab5406d3e req-56b570e2-4a46-4aea-817c-78f8b2ae813d service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:50.710545 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-77b2c4b9-eed9-4ef1-b42c-23fab5406d3e req-56b570e2-4a46-4aea-817c-78f8b2ae813d service nova] Creating event network-vif-plugged:700f3c7c-ee4f-426b-9bf3-1e03b2102f81 for instance a31a978e-d8fb-4412-ad8c-999a3f18cfce on hv-cinder-85918 Sep 26 05:29:50.715726 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-77b2c4b9-eed9-4ef1-b42c-23fab5406d3e req-56b570e2-4a46-4aea-817c-78f8b2ae813d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092031 Sep 26 05:29:50.716466 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 50/104] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:29:50.944155 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-87717518-8b5f-48d6-8f38-86f89ba85640 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:50.944948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-87717518-8b5f-48d6-8f38-86f89ba85640 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:50.957596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-87717518-8b5f-48d6-8f38-86f89ba85640 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:50.957596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-87717518-8b5f-48d6-8f38-86f89ba85640 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:50.961579 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-87717518-8b5f-48d6-8f38-86f89ba85640 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:50.964103 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-87717518-8b5f-48d6-8f38-86f89ba85640 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:50.966302 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-849f6db0-a3a2-47e9-856e-0193e0d97c65 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:50.966445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-87717518-8b5f-48d6-8f38-86f89ba85640 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:50.966763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-87717518-8b5f-48d6-8f38-86f89ba85640 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:50.970151 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-849f6db0-a3a2-47e9-856e-0193e0d97c65 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:50.980709 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-849f6db0-a3a2-47e9-856e-0193e0d97c65 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:50.982302 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-849f6db0-a3a2-47e9-856e-0193e0d97c65 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:50.983002 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-849f6db0-a3a2-47e9-856e-0193e0d97c65 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:50.984003 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-849f6db0-a3a2-47e9-856e-0193e0d97c65 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:50.984747 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-849f6db0-a3a2-47e9-856e-0193e0d97c65 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:50.985791 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-849f6db0-a3a2-47e9-856e-0193e0d97c65 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:51.308898 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-849f6db0-a3a2-47e9-856e-0193e0d97c65 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:51.323587 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-849f6db0-a3a2-47e9-856e-0193e0d97c65 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:51.328028 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-849f6db0-a3a2-47e9-856e-0193e0d97c65 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:51.329330 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-849f6db0-a3a2-47e9-856e-0193e0d97c65 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1407 microversion: 2.20 time: 0.368591 Sep 26 05:29:51.334322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 51/105] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:29:50 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1407 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:29:51.350378 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-87717518-8b5f-48d6-8f38-86f89ba85640 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:51.357806 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b139f7bc-3769-4789-bc6f-86e1547ed018 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:51.358421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b139f7bc-3769-4789-bc6f-86e1547ed018 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:51.371907 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-87717518-8b5f-48d6-8f38-86f89ba85640 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1322 microversion: 2.1 time: 0.429115 Sep 26 05:29:51.372596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 55/106] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:50 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:51.374410 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b139f7bc-3769-4789-bc6f-86e1547ed018 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:51.375113 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b139f7bc-3769-4789-bc6f-86e1547ed018 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:51.375858 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b139f7bc-3769-4789-bc6f-86e1547ed018 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:51.376597 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b139f7bc-3769-4789-bc6f-86e1547ed018 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:51.377193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b139f7bc-3769-4789-bc6f-86e1547ed018 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:51.377767 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b139f7bc-3769-4789-bc6f-86e1547ed018 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:51.437144 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-34750251-995a-4c2b-80e0-14cee2f52dcb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:51.438545 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-34750251-995a-4c2b-80e0-14cee2f52dcb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:51.460932 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-34750251-995a-4c2b-80e0-14cee2f52dcb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:51.461505 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-34750251-995a-4c2b-80e0-14cee2f52dcb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:51.461960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-34750251-995a-4c2b-80e0-14cee2f52dcb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:51.462696 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-34750251-995a-4c2b-80e0-14cee2f52dcb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:51.464235 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-34750251-995a-4c2b-80e0-14cee2f52dcb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:51.464701 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-34750251-995a-4c2b-80e0-14cee2f52dcb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:51.574301 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b139f7bc-3769-4789-bc6f-86e1547ed018 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:51.582333 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b139f7bc-3769-4789-bc6f-86e1547ed018 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.245694 Sep 26 05:29:51.588283 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 52/107] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:51 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:51.633734 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-34750251-995a-4c2b-80e0-14cee2f52dcb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:51.641575 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-34750251-995a-4c2b-80e0-14cee2f52dcb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1366 microversion: 2.1 time: 0.209551 Sep 26 05:29:51.642137 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 56/108] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:51 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:29:52.358678 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-545ce7c0-a2bc-4c70-b767-2fb687798c5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:52.359289 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-545ce7c0-a2bc-4c70-b767-2fb687798c5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:52.365755 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-545ce7c0-a2bc-4c70-b767-2fb687798c5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:52.366166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-545ce7c0-a2bc-4c70-b767-2fb687798c5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:52.366599 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-545ce7c0-a2bc-4c70-b767-2fb687798c5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:52.367276 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-545ce7c0-a2bc-4c70-b767-2fb687798c5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:52.367721 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-545ce7c0-a2bc-4c70-b767-2fb687798c5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:52.368140 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-545ce7c0-a2bc-4c70-b767-2fb687798c5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:52.399521 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5e850e73-4f11-4689-a3f9-77b0622ad7ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:52.400194 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5e850e73-4f11-4689-a3f9-77b0622ad7ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:52.406140 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5e850e73-4f11-4689-a3f9-77b0622ad7ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:52.406619 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5e850e73-4f11-4689-a3f9-77b0622ad7ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:52.407049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5e850e73-4f11-4689-a3f9-77b0622ad7ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:52.407834 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5e850e73-4f11-4689-a3f9-77b0622ad7ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:52.408310 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5e850e73-4f11-4689-a3f9-77b0622ad7ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:52.408739 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5e850e73-4f11-4689-a3f9-77b0622ad7ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:52.539575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-545ce7c0-a2bc-4c70-b767-2fb687798c5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:52.547520 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-545ce7c0-a2bc-4c70-b767-2fb687798c5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:52.548981 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-545ce7c0-a2bc-4c70-b767-2fb687798c5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:52.550071 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-545ce7c0-a2bc-4c70-b767-2fb687798c5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1407 microversion: 2.20 time: 0.195398 Sep 26 05:29:52.550628 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 53/109] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:29:52 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:29:52.569041 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5e850e73-4f11-4689-a3f9-77b0622ad7ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:52.576516 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5e850e73-4f11-4689-a3f9-77b0622ad7ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1322 microversion: 2.1 time: 0.181525 Sep 26 05:29:52.577071 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 57/110] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:52 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:29:52.611199 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-976be152-ee95-4e39-b7ca-3ceba277409b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:52.611986 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-976be152-ee95-4e39-b7ca-3ceba277409b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:52.618127 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-976be152-ee95-4e39-b7ca-3ceba277409b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:52.618683 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-976be152-ee95-4e39-b7ca-3ceba277409b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:52.619121 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-976be152-ee95-4e39-b7ca-3ceba277409b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:52.619808 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-976be152-ee95-4e39-b7ca-3ceba277409b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:52.620269 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-976be152-ee95-4e39-b7ca-3ceba277409b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:52.620848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-976be152-ee95-4e39-b7ca-3ceba277409b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:52.664160 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-0570dc91-a74e-488e-992c-4ee5ad25527d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:52.664847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-0570dc91-a74e-488e-992c-4ee5ad25527d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:52.671303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0570dc91-a74e-488e-992c-4ee5ad25527d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:52.671802 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0570dc91-a74e-488e-992c-4ee5ad25527d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:52.672244 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0570dc91-a74e-488e-992c-4ee5ad25527d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:52.672964 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0570dc91-a74e-488e-992c-4ee5ad25527d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:52.673414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0570dc91-a74e-488e-992c-4ee5ad25527d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:52.673841 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0570dc91-a74e-488e-992c-4ee5ad25527d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:52.814115 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-976be152-ee95-4e39-b7ca-3ceba277409b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:52.825912 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-976be152-ee95-4e39-b7ca-3ceba277409b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.218848 Sep 26 05:29:52.836367 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 54/111] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:52 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:52.843751 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0570dc91-a74e-488e-992c-4ee5ad25527d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:52.851796 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-0570dc91-a74e-488e-992c-4ee5ad25527d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1366 microversion: 2.1 time: 0.191493 Sep 26 05:29:52.852391 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 58/112] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:52 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:29:53.018722 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-8bd4d6d5-5ac3-49a0-9bd7-3c8b177852a9 req-dce18939-dce1-4bf0-ab5b-ef051ac0b0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01274a67-17fb-45e3-9f2a-6a718b15b902", "name": "network-vif-plugged", "status": "completed", "tag": "f70e6461-7f87-4ee4-b3e4-f7d4db390598"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:29:53.027866 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-8bd4d6d5-5ac3-49a0-9bd7-3c8b177852a9 req-dce18939-dce1-4bf0-ab5b-ef051ac0b0b8 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:53.028384 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-8bd4d6d5-5ac3-49a0-9bd7-3c8b177852a9 req-dce18939-dce1-4bf0-ab5b-ef051ac0b0b8 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:53.028814 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-8bd4d6d5-5ac3-49a0-9bd7-3c8b177852a9 req-dce18939-dce1-4bf0-ab5b-ef051ac0b0b8 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:53.040581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-8bd4d6d5-5ac3-49a0-9bd7-3c8b177852a9 req-dce18939-dce1-4bf0-ab5b-ef051ac0b0b8 service nova] Creating event network-vif-plugged:f70e6461-7f87-4ee4-b3e4-f7d4db390598 for instance 01274a67-17fb-45e3-9f2a-6a718b15b902 on hv-cinder-85918 Sep 26 05:29:53.045543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-8bd4d6d5-5ac3-49a0-9bd7-3c8b177852a9 req-dce18939-dce1-4bf0-ab5b-ef051ac0b0b8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031012 Sep 26 05:29:53.046143 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 55/113] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:29:53.574707 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-29e5796d-a190-4d2b-acad-77515263aed5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:53.575316 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-29e5796d-a190-4d2b-acad-77515263aed5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:53.581243 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-29e5796d-a190-4d2b-acad-77515263aed5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:53.581723 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-29e5796d-a190-4d2b-acad-77515263aed5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:53.582157 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-29e5796d-a190-4d2b-acad-77515263aed5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:53.583146 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-29e5796d-a190-4d2b-acad-77515263aed5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:53.583687 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-29e5796d-a190-4d2b-acad-77515263aed5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:53.584110 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-29e5796d-a190-4d2b-acad-77515263aed5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:53.599925 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-115b109a-13ed-4409-b0a6-3442f83ee232 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:53.600675 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-115b109a-13ed-4409-b0a6-3442f83ee232 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:53.606656 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-115b109a-13ed-4409-b0a6-3442f83ee232 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:53.607139 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-115b109a-13ed-4409-b0a6-3442f83ee232 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:53.607575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-115b109a-13ed-4409-b0a6-3442f83ee232 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:53.608272 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-115b109a-13ed-4409-b0a6-3442f83ee232 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:53.608729 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-115b109a-13ed-4409-b0a6-3442f83ee232 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:53.609158 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-115b109a-13ed-4409-b0a6-3442f83ee232 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:53.707562 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:53.946444 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-29e5796d-a190-4d2b-acad-77515263aed5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:53.954568 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-29e5796d-a190-4d2b-acad-77515263aed5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:53.956031 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-29e5796d-a190-4d2b-acad-77515263aed5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:53.956775 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-115b109a-13ed-4409-b0a6-3442f83ee232 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:53.957173 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-29e5796d-a190-4d2b-acad-77515263aed5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1407 microversion: 2.20 time: 0.386441 Sep 26 05:29:53.958218 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 59/114] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:29:53 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1407 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:29:53.962903 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e412b30f-1e38-4bea-950f-50bf2744a3db tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:53.963770 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e412b30f-1e38-4bea-950f-50bf2744a3db tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:53.965141 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-115b109a-13ed-4409-b0a6-3442f83ee232 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1322 microversion: 2.1 time: 0.370027 Sep 26 05:29:53.965699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 56/115] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:53 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:29:53.969796 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e412b30f-1e38-4bea-950f-50bf2744a3db tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:53.970380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e412b30f-1e38-4bea-950f-50bf2744a3db tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:53.970681 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-65708ff4-7eca-4248-b4fd-f05330da9660 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:53.970950 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e412b30f-1e38-4bea-950f-50bf2744a3db tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:53.971665 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-65708ff4-7eca-4248-b4fd-f05330da9660 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:53.971770 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e412b30f-1e38-4bea-950f-50bf2744a3db tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:53.972225 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e412b30f-1e38-4bea-950f-50bf2744a3db tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:53.972749 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e412b30f-1e38-4bea-950f-50bf2744a3db tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:53.980637 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-65708ff4-7eca-4248-b4fd-f05330da9660 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:53.980637 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-65708ff4-7eca-4248-b4fd-f05330da9660 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:53.980880 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-65708ff4-7eca-4248-b4fd-f05330da9660 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:53.981432 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-65708ff4-7eca-4248-b4fd-f05330da9660 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:53.981884 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-65708ff4-7eca-4248-b4fd-f05330da9660 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:53.982308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-65708ff4-7eca-4248-b4fd-f05330da9660 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:54.169760 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e412b30f-1e38-4bea-950f-50bf2744a3db tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:54.173888 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-65708ff4-7eca-4248-b4fd-f05330da9660 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:54.177621 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e412b30f-1e38-4bea-950f-50bf2744a3db tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.218313 Sep 26 05:29:54.178196 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 60/116] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:53 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:54.182138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-65708ff4-7eca-4248-b4fd-f05330da9660 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1366 microversion: 2.1 time: 0.215190 Sep 26 05:29:54.182700 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 57/117] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:53 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:54.983812 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7385a8a2-0a8f-410c-88df-ea440cd4a665 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:54.984554 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7385a8a2-0a8f-410c-88df-ea440cd4a665 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:54.990523 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-73b74f21-2fb3-404e-8892-b2fef23d16c4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:54.991283 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-73b74f21-2fb3-404e-8892-b2fef23d16c4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:54.991561 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7385a8a2-0a8f-410c-88df-ea440cd4a665 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:54.992053 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7385a8a2-0a8f-410c-88df-ea440cd4a665 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:54.992508 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7385a8a2-0a8f-410c-88df-ea440cd4a665 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:54.993196 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7385a8a2-0a8f-410c-88df-ea440cd4a665 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:54.993644 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7385a8a2-0a8f-410c-88df-ea440cd4a665 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:54.994060 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7385a8a2-0a8f-410c-88df-ea440cd4a665 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:54.998533 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-73b74f21-2fb3-404e-8892-b2fef23d16c4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:54.999017 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-73b74f21-2fb3-404e-8892-b2fef23d16c4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:54.999453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-73b74f21-2fb3-404e-8892-b2fef23d16c4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:55.000157 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-73b74f21-2fb3-404e-8892-b2fef23d16c4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:55.000786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-73b74f21-2fb3-404e-8892-b2fef23d16c4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:55.001345 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-73b74f21-2fb3-404e-8892-b2fef23d16c4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:55.183343 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-73b74f21-2fb3-404e-8892-b2fef23d16c4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:55.191151 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-73b74f21-2fb3-404e-8892-b2fef23d16c4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1322 microversion: 2.1 time: 0.206496 Sep 26 05:29:55.192032 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 58/118] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:54 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:55.196776 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7385a8a2-0a8f-410c-88df-ea440cd4a665 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:55.203998 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4ff4f295-170b-4cd0-8228-2afb1568ef55 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:55.204927 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4ff4f295-170b-4cd0-8228-2afb1568ef55 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:55.205503 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7385a8a2-0a8f-410c-88df-ea440cd4a665 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:55.207278 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7385a8a2-0a8f-410c-88df-ea440cd4a665 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:55.209536 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7385a8a2-0a8f-410c-88df-ea440cd4a665 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1407 microversion: 2.20 time: 0.229583 Sep 26 05:29:55.210105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 61/119] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:29:54 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:29:55.212690 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4ff4f295-170b-4cd0-8228-2afb1568ef55 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:55.213273 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4ff4f295-170b-4cd0-8228-2afb1568ef55 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:55.213766 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4ff4f295-170b-4cd0-8228-2afb1568ef55 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:55.214535 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4ff4f295-170b-4cd0-8228-2afb1568ef55 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:55.215101 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4ff4f295-170b-4cd0-8228-2afb1568ef55 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:55.215597 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4ff4f295-170b-4cd0-8228-2afb1568ef55 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:55.217018 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-edca21fc-333e-4452-bbc3-7b09406ad4dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:55.217820 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-edca21fc-333e-4452-bbc3-7b09406ad4dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:55.226621 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-edca21fc-333e-4452-bbc3-7b09406ad4dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:55.227364 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-edca21fc-333e-4452-bbc3-7b09406ad4dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:55.227977 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-edca21fc-333e-4452-bbc3-7b09406ad4dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:55.229003 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-edca21fc-333e-4452-bbc3-7b09406ad4dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:55.229661 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-edca21fc-333e-4452-bbc3-7b09406ad4dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:55.230148 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-edca21fc-333e-4452-bbc3-7b09406ad4dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:55.426087 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4ff4f295-170b-4cd0-8228-2afb1568ef55 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:55.432662 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-edca21fc-333e-4452-bbc3-7b09406ad4dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:55.438098 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4ff4f295-170b-4cd0-8228-2afb1568ef55 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.239779 Sep 26 05:29:55.439182 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 59/120] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:55 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:29:55.443513 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-edca21fc-333e-4452-bbc3-7b09406ad4dc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1366 microversion: 2.1 time: 0.232144 Sep 26 05:29:55.444159 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 62/121] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:55 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:56.215853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-175228f4-bedf-4aab-95a3-86b057d744a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:56.216486 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-175228f4-bedf-4aab-95a3-86b057d744a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:56.218461 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=10 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:56.223995 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-175228f4-bedf-4aab-95a3-86b057d744a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:56.224498 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-175228f4-bedf-4aab-95a3-86b057d744a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:56.224931 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-175228f4-bedf-4aab-95a3-86b057d744a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:56.225599 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-175228f4-bedf-4aab-95a3-86b057d744a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:56.226041 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-175228f4-bedf-4aab-95a3-86b057d744a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:56.226457 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-175228f4-bedf-4aab-95a3-86b057d744a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:56.239727 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-df21c27f-c354-454f-a02b-ea103fee3099 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:56.240636 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-df21c27f-c354-454f-a02b-ea103fee3099 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:56.246865 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-df21c27f-c354-454f-a02b-ea103fee3099 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:56.247344 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-df21c27f-c354-454f-a02b-ea103fee3099 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:56.247777 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-df21c27f-c354-454f-a02b-ea103fee3099 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:56.248490 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-df21c27f-c354-454f-a02b-ea103fee3099 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:56.248940 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-df21c27f-c354-454f-a02b-ea103fee3099 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:56.249362 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-df21c27f-c354-454f-a02b-ea103fee3099 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:56.253324 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=100 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:56.419950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-175228f4-bedf-4aab-95a3-86b057d744a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:56.423410 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:56.429318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-175228f4-bedf-4aab-95a3-86b057d744a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1322 microversion: 2.1 time: 0.217214 Sep 26 05:29:56.429892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 60/122] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:56 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:56.431639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-df21c27f-c354-454f-a02b-ea103fee3099 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:56.439753 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-df21c27f-c354-454f-a02b-ea103fee3099 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:56.441223 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-df21c27f-c354-454f-a02b-ea103fee3099 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:56.442360 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-df21c27f-c354-454f-a02b-ea103fee3099 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1407 microversion: 2.20 time: 0.210939 Sep 26 05:29:56.442898 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 63/123] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:29:56 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:29:56.461564 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-952d86e4-7e56-4f00-949f-1223bfa8eca7 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:56.462204 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-952d86e4-7e56-4f00-949f-1223bfa8eca7 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:56.466532 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a9934529-2ed1-4a44-ba79-110d2e546f90 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:56.467137 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a9934529-2ed1-4a44-ba79-110d2e546f90 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:56.468232 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-952d86e4-7e56-4f00-949f-1223bfa8eca7 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:56.468745 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-952d86e4-7e56-4f00-949f-1223bfa8eca7 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:56.469178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-952d86e4-7e56-4f00-949f-1223bfa8eca7 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:56.469863 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-952d86e4-7e56-4f00-949f-1223bfa8eca7 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:56.470310 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-952d86e4-7e56-4f00-949f-1223bfa8eca7 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:56.470729 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-952d86e4-7e56-4f00-949f-1223bfa8eca7 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:56.473678 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a9934529-2ed1-4a44-ba79-110d2e546f90 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:56.474161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a9934529-2ed1-4a44-ba79-110d2e546f90 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:56.474686 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a9934529-2ed1-4a44-ba79-110d2e546f90 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:56.475386 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a9934529-2ed1-4a44-ba79-110d2e546f90 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:56.475842 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a9934529-2ed1-4a44-ba79-110d2e546f90 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:56.476316 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a9934529-2ed1-4a44-ba79-110d2e546f90 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:56.665139 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-952d86e4-7e56-4f00-949f-1223bfa8eca7 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:56.669104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a9934529-2ed1-4a44-ba79-110d2e546f90 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:56.672700 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-952d86e4-7e56-4f00-949f-1223bfa8eca7 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.215098 Sep 26 05:29:56.673262 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 61/124] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:56 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:56.676902 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a9934529-2ed1-4a44-ba79-110d2e546f90 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1366 microversion: 2.1 time: 0.213890 Sep 26 05:29:56.677453 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 64/125] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:56 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:29:57.451664 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-05a2b07f-3af0-4943-b0fb-ad5f0756480c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:57.452282 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-05a2b07f-3af0-4943-b0fb-ad5f0756480c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:57.458302 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-05a2b07f-3af0-4943-b0fb-ad5f0756480c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:57.458775 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-05a2b07f-3af0-4943-b0fb-ad5f0756480c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:57.459205 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-05a2b07f-3af0-4943-b0fb-ad5f0756480c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:57.459878 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-05a2b07f-3af0-4943-b0fb-ad5f0756480c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:57.460347 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-05a2b07f-3af0-4943-b0fb-ad5f0756480c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:57.460763 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-05a2b07f-3af0-4943-b0fb-ad5f0756480c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:57.465807 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1355a021-61fc-49c4-be5e-e19dc47b7b42 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:57.466414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-1355a021-61fc-49c4-be5e-e19dc47b7b42 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:57.472207 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1355a021-61fc-49c4-be5e-e19dc47b7b42 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:57.472723 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1355a021-61fc-49c4-be5e-e19dc47b7b42 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:57.473165 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1355a021-61fc-49c4-be5e-e19dc47b7b42 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:57.473858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1355a021-61fc-49c4-be5e-e19dc47b7b42 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:57.474302 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1355a021-61fc-49c4-be5e-e19dc47b7b42 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:57.474730 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1355a021-61fc-49c4-be5e-e19dc47b7b42 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:57.658593 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-05a2b07f-3af0-4943-b0fb-ad5f0756480c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:57.664186 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1355a021-61fc-49c4-be5e-e19dc47b7b42 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:57.668383 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-05a2b07f-3af0-4943-b0fb-ad5f0756480c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1322 microversion: 2.1 time: 0.220471 Sep 26 05:29:57.669087 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 62/126] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:57 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:57.679578 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1355a021-61fc-49c4-be5e-e19dc47b7b42 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:57.681059 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1355a021-61fc-49c4-be5e-e19dc47b7b42 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:57.682187 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1355a021-61fc-49c4-be5e-e19dc47b7b42 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1407 microversion: 2.20 time: 0.220197 Sep 26 05:29:57.683106 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 65/127] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:29:57 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:29:57.697318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-98e74b81-7379-43b9-ac61-1cd33c561b53 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:57.697839 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-98e74b81-7379-43b9-ac61-1cd33c561b53 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:57.701157 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6f4a65b8-ca53-49e6-b584-a0b60eec3dc7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:57.701939 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6f4a65b8-ca53-49e6-b584-a0b60eec3dc7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:57.704360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98e74b81-7379-43b9-ac61-1cd33c561b53 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:57.704846 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98e74b81-7379-43b9-ac61-1cd33c561b53 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:57.705308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98e74b81-7379-43b9-ac61-1cd33c561b53 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:57.705965 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98e74b81-7379-43b9-ac61-1cd33c561b53 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:57.706434 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98e74b81-7379-43b9-ac61-1cd33c561b53 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:57.706838 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98e74b81-7379-43b9-ac61-1cd33c561b53 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:57.709041 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6f4a65b8-ca53-49e6-b584-a0b60eec3dc7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:57.709588 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6f4a65b8-ca53-49e6-b584-a0b60eec3dc7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:57.710083 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6f4a65b8-ca53-49e6-b584-a0b60eec3dc7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:57.710866 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6f4a65b8-ca53-49e6-b584-a0b60eec3dc7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:57.711381 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6f4a65b8-ca53-49e6-b584-a0b60eec3dc7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:57.712026 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6f4a65b8-ca53-49e6-b584-a0b60eec3dc7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:57.898875 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-98e74b81-7379-43b9-ac61-1cd33c561b53 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:57.909107 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-98e74b81-7379-43b9-ac61-1cd33c561b53 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.215887 Sep 26 05:29:57.912688 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 63/128] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:57 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:57.924925 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6f4a65b8-ca53-49e6-b584-a0b60eec3dc7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:57.938731 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6f4a65b8-ca53-49e6-b584-a0b60eec3dc7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1366 microversion: 2.1 time: 0.242813 Sep 26 05:29:57.939304 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 66/129] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:57 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:58.695237 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-157effcb-2c35-4f66-a5af-1c01b146390d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:58.697602 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-157effcb-2c35-4f66-a5af-1c01b146390d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:58.719560 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f37ef7f2-e414-4958-8047-8f59c6894268 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:58.720587 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f37ef7f2-e414-4958-8047-8f59c6894268 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:58.729924 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-157effcb-2c35-4f66-a5af-1c01b146390d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:58.730546 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-157effcb-2c35-4f66-a5af-1c01b146390d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:58.731156 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-157effcb-2c35-4f66-a5af-1c01b146390d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:58.732151 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-157effcb-2c35-4f66-a5af-1c01b146390d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:58.742708 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-157effcb-2c35-4f66-a5af-1c01b146390d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:58.743279 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-157effcb-2c35-4f66-a5af-1c01b146390d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:58.751652 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f37ef7f2-e414-4958-8047-8f59c6894268 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:58.755326 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f37ef7f2-e414-4958-8047-8f59c6894268 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:58.756089 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f37ef7f2-e414-4958-8047-8f59c6894268 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:58.756985 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f37ef7f2-e414-4958-8047-8f59c6894268 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:58.759046 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f37ef7f2-e414-4958-8047-8f59c6894268 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:58.759816 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f37ef7f2-e414-4958-8047-8f59c6894268 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:58.970284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-157effcb-2c35-4f66-a5af-1c01b146390d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:58.973326 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f37ef7f2-e414-4958-8047-8f59c6894268 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:58.987262 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f37ef7f2-e414-4958-8047-8f59c6894268 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:58.991956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-157effcb-2c35-4f66-a5af-1c01b146390d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1322 microversion: 2.1 time: 0.304307 Sep 26 05:29:58.992924 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 64/130] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:58 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:29:58.996547 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f37ef7f2-e414-4958-8047-8f59c6894268 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:58.997839 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f37ef7f2-e414-4958-8047-8f59c6894268 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1407 microversion: 2.20 time: 0.286151 Sep 26 05:29:58.999106 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 67/131] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:29:58 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:29:59.004906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4cb9d059-efbd-4345-8ff1-f0de18134ccd tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:59.008032 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6d4d42c9-de8f-48d9-b021-7740e6f424b2 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:29:59.008680 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6d4d42c9-de8f-48d9-b021-7740e6f424b2 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:59.012079 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4cb9d059-efbd-4345-8ff1-f0de18134ccd tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:29:59.018393 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4cb9d059-efbd-4345-8ff1-f0de18134ccd tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:59.018723 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6d4d42c9-de8f-48d9-b021-7740e6f424b2 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:59.019100 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4cb9d059-efbd-4345-8ff1-f0de18134ccd tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:59.019319 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6d4d42c9-de8f-48d9-b021-7740e6f424b2 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:59.019538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4cb9d059-efbd-4345-8ff1-f0de18134ccd tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:59.020156 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6d4d42c9-de8f-48d9-b021-7740e6f424b2 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:59.020779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4cb9d059-efbd-4345-8ff1-f0de18134ccd tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:59.021147 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6d4d42c9-de8f-48d9-b021-7740e6f424b2 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:59.021278 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4cb9d059-efbd-4345-8ff1-f0de18134ccd tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:59.021694 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6d4d42c9-de8f-48d9-b021-7740e6f424b2 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:59.021871 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4cb9d059-efbd-4345-8ff1-f0de18134ccd tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:59.022246 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6d4d42c9-de8f-48d9-b021-7740e6f424b2 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:59.275546 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4cb9d059-efbd-4345-8ff1-f0de18134ccd tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:59.286709 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4cb9d059-efbd-4345-8ff1-f0de18134ccd tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.289977 Sep 26 05:29:59.288532 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6d4d42c9-de8f-48d9-b021-7740e6f424b2 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:29:59.289364 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 65/132] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:58 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:59.309088 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6d4d42c9-de8f-48d9-b021-7740e6f424b2 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1366 microversion: 2.1 time: 0.303881 Sep 26 05:29:59.310379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 68/133] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:29:58 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:59.908551 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-e7da75b1-bfff-45ff-a417-5257b437338e req-2214a57c-c583-4e5f-b417-b8d98b587fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6937727-fb89-499b-91ea-fa6b399607f7", "name": "network-vif-plugged", "status": "completed", "tag": "38b128ed-e00f-4c9c-93fb-be3a153d50bf"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:29:59.926156 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-e7da75b1-bfff-45ff-a417-5257b437338e req-2214a57c-c583-4e5f-b417-b8d98b587fef service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:29:59.927006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-e7da75b1-bfff-45ff-a417-5257b437338e req-2214a57c-c583-4e5f-b417-b8d98b587fef service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:29:59.931086 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-e7da75b1-bfff-45ff-a417-5257b437338e req-2214a57c-c583-4e5f-b417-b8d98b587fef service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:29:59.961061 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-e7da75b1-bfff-45ff-a417-5257b437338e req-2214a57c-c583-4e5f-b417-b8d98b587fef service nova] Creating event network-vif-plugged:38b128ed-e00f-4c9c-93fb-be3a153d50bf for instance e6937727-fb89-499b-91ea-fa6b399607f7 on hv-cinder-85918 Sep 26 05:29:59.969679 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-e7da75b1-bfff-45ff-a417-5257b437338e req-2214a57c-c583-4e5f-b417-b8d98b587fef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063912 Sep 26 05:29:59.972660 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 66/134] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:30:00.018064 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d159767a-74a9-4a12-9fd0-057730cc2b7c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:00.028153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e65b6822-afa0-4ee2-8334-cc505c1ee255 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:00.028325 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e65b6822-afa0-4ee2-8334-cc505c1ee255 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:00.030852 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d159767a-74a9-4a12-9fd0-057730cc2b7c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:00.051509 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d159767a-74a9-4a12-9fd0-057730cc2b7c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:00.052005 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d159767a-74a9-4a12-9fd0-057730cc2b7c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:00.061524 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d159767a-74a9-4a12-9fd0-057730cc2b7c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:00.065585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e65b6822-afa0-4ee2-8334-cc505c1ee255 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:00.066364 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d159767a-74a9-4a12-9fd0-057730cc2b7c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:00.067764 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d159767a-74a9-4a12-9fd0-057730cc2b7c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:00.068051 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e65b6822-afa0-4ee2-8334-cc505c1ee255 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:00.068697 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e65b6822-afa0-4ee2-8334-cc505c1ee255 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:00.069656 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e65b6822-afa0-4ee2-8334-cc505c1ee255 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:00.071901 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e65b6822-afa0-4ee2-8334-cc505c1ee255 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:00.072716 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e65b6822-afa0-4ee2-8334-cc505c1ee255 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:00.077501 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d159767a-74a9-4a12-9fd0-057730cc2b7c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:00.450950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e65b6822-afa0-4ee2-8334-cc505c1ee255 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:00.471747 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e65b6822-afa0-4ee2-8334-cc505c1ee255 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:00.476705 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e65b6822-afa0-4ee2-8334-cc505c1ee255 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:00.479696 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e65b6822-afa0-4ee2-8334-cc505c1ee255 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1407 microversion: 2.20 time: 0.457285 Sep 26 05:30:00.504522 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 67/135] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:30:00 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:30:00.518066 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8d085666-cb3a-4961-93de-34691efea20b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:00.518907 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8d085666-cb3a-4961-93de-34691efea20b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:00.526868 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8d085666-cb3a-4961-93de-34691efea20b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:00.527435 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8d085666-cb3a-4961-93de-34691efea20b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:00.528079 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8d085666-cb3a-4961-93de-34691efea20b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:00.530133 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8d085666-cb3a-4961-93de-34691efea20b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:00.530794 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8d085666-cb3a-4961-93de-34691efea20b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:00.531657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8d085666-cb3a-4961-93de-34691efea20b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:00.586659 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d159767a-74a9-4a12-9fd0-057730cc2b7c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:00.609923 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d159767a-74a9-4a12-9fd0-057730cc2b7c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1322 microversion: 2.1 time: 0.587824 Sep 26 05:30:00.619031 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 69/136] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:00 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1322 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:00.655361 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-8567ad3a-7172-4a94-a99e-edbcaa5f5ed5 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:00.656175 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-8567ad3a-7172-4a94-a99e-edbcaa5f5ed5 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:00.697362 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8567ad3a-7172-4a94-a99e-edbcaa5f5ed5 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:00.697870 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8567ad3a-7172-4a94-a99e-edbcaa5f5ed5 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:00.698310 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8567ad3a-7172-4a94-a99e-edbcaa5f5ed5 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:00.699035 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8567ad3a-7172-4a94-a99e-edbcaa5f5ed5 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:00.699491 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8567ad3a-7172-4a94-a99e-edbcaa5f5ed5 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:00.699913 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8567ad3a-7172-4a94-a99e-edbcaa5f5ed5 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:00.900313 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8d085666-cb3a-4961-93de-34691efea20b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:00.917727 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8d085666-cb3a-4961-93de-34691efea20b tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1314 microversion: 2.1 time: 0.410386 Sep 26 05:30:00.936561 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 68/137] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:00 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:01.020935 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8567ad3a-7172-4a94-a99e-edbcaa5f5ed5 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:01.035854 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-8567ad3a-7172-4a94-a99e-edbcaa5f5ed5 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1366 microversion: 2.1 time: 0.411862 Sep 26 05:30:01.038074 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 70/138] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:00 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:01.515858 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ded888ff-e3e1-4100-bd12-d7b60a60ba0a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:01.516925 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ded888ff-e3e1-4100-bd12-d7b60a60ba0a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:01.527538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ded888ff-e3e1-4100-bd12-d7b60a60ba0a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:01.530438 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ded888ff-e3e1-4100-bd12-d7b60a60ba0a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:01.531698 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ded888ff-e3e1-4100-bd12-d7b60a60ba0a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:01.534281 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ded888ff-e3e1-4100-bd12-d7b60a60ba0a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:01.535335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ded888ff-e3e1-4100-bd12-d7b60a60ba0a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:01.538200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ded888ff-e3e1-4100-bd12-d7b60a60ba0a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:01.634542 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-588f0196-5642-4e48-958a-1aa083c21b2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:01.635434 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-588f0196-5642-4e48-958a-1aa083c21b2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:01.644769 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-588f0196-5642-4e48-958a-1aa083c21b2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:01.645998 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-588f0196-5642-4e48-958a-1aa083c21b2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:01.646659 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-588f0196-5642-4e48-958a-1aa083c21b2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:01.647599 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-588f0196-5642-4e48-958a-1aa083c21b2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:01.648559 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-588f0196-5642-4e48-958a-1aa083c21b2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:01.649617 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-588f0196-5642-4e48-958a-1aa083c21b2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:01.842754 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ded888ff-e3e1-4100-bd12-d7b60a60ba0a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:01.860095 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ded888ff-e3e1-4100-bd12-d7b60a60ba0a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:01.861731 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ded888ff-e3e1-4100-bd12-d7b60a60ba0a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:01.864292 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ded888ff-e3e1-4100-bd12-d7b60a60ba0a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1407 microversion: 2.20 time: 0.356049 Sep 26 05:30:01.884786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 69/139] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:30:01 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1407 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:30:01.895475 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-588f0196-5642-4e48-958a-1aa083c21b2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:01.909292 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-588f0196-5642-4e48-958a-1aa083c21b2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1322 microversion: 2.1 time: 0.280117 Sep 26 05:30:01.910310 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 71/140] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:01 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:30:01.949225 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-53feedfb-436f-422b-964e-024dcaa55185 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:01.952681 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-53feedfb-436f-422b-964e-024dcaa55185 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:01.992792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53feedfb-436f-422b-964e-024dcaa55185 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:01.994773 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53feedfb-436f-422b-964e-024dcaa55185 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:02.003362 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-d40acc6c-6d82-4d99-8857-67f8ea9d432d req-23f7852a-ec6b-4aed-b7d4-dcb991c104f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffa337e-39e1-4edc-9a0d-4468ff05c577", "name": "network-vif-plugged", "status": "completed", "tag": "db14dfec-952b-46e2-9617-72801c005bb3"}, {"server_uuid": "149e1a24-0c3f-4697-8982-771b7bbb4215", "name": "network-vif-plugged", "status": "completed", "tag": "61f405ec-53a2-45d3-97e1-b2c513f8244a"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:30:02.010300 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53feedfb-436f-422b-964e-024dcaa55185 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:02.011306 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53feedfb-436f-422b-964e-024dcaa55185 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:02.014692 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53feedfb-436f-422b-964e-024dcaa55185 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:02.015138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53feedfb-436f-422b-964e-024dcaa55185 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:02.026993 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-d40acc6c-6d82-4d99-8857-67f8ea9d432d req-23f7852a-ec6b-4aed-b7d4-dcb991c104f0 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:02.028127 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-d40acc6c-6d82-4d99-8857-67f8ea9d432d req-23f7852a-ec6b-4aed-b7d4-dcb991c104f0 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:02.029581 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-d40acc6c-6d82-4d99-8857-67f8ea9d432d req-23f7852a-ec6b-4aed-b7d4-dcb991c104f0 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:02.067953 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-d40acc6c-6d82-4d99-8857-67f8ea9d432d req-23f7852a-ec6b-4aed-b7d4-dcb991c104f0 service nova] Creating event network-vif-plugged:db14dfec-952b-46e2-9617-72801c005bb3 for instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 on hv-cinder-85918 Sep 26 05:30:02.068780 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-d40acc6c-6d82-4d99-8857-67f8ea9d432d req-23f7852a-ec6b-4aed-b7d4-dcb991c104f0 service nova] Creating event network-vif-plugged:61f405ec-53a2-45d3-97e1-b2c513f8244a for instance 149e1a24-0c3f-4697-8982-771b7bbb4215 on hv-cinder-85918 Sep 26 05:30:02.083679 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-d40acc6c-6d82-4d99-8857-67f8ea9d432d req-23f7852a-ec6b-4aed-b7d4-dcb991c104f0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086752 Sep 26 05:30:02.085126 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 72/141] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:30:02.131608 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7c097746-4850-4168-b456-a792b2ae8bb4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:02.132733 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7c097746-4850-4168-b456-a792b2ae8bb4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:02.165046 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7c097746-4850-4168-b456-a792b2ae8bb4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:02.165554 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7c097746-4850-4168-b456-a792b2ae8bb4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:02.165969 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7c097746-4850-4168-b456-a792b2ae8bb4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:02.166663 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7c097746-4850-4168-b456-a792b2ae8bb4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:02.167105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7c097746-4850-4168-b456-a792b2ae8bb4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:02.167523 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7c097746-4850-4168-b456-a792b2ae8bb4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:02.367649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-53feedfb-436f-422b-964e-024dcaa55185 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:02.378676 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-53feedfb-436f-422b-964e-024dcaa55185 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1500 microversion: 2.1 time: 0.439024 Sep 26 05:30:02.388882 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 70/142] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:01 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1500 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:02.573342 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7c097746-4850-4168-b456-a792b2ae8bb4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:02.583795 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7c097746-4850-4168-b456-a792b2ae8bb4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1366 microversion: 2.1 time: 0.494771 Sep 26 05:30:02.591314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 73/143] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:02 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1366 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:02.892526 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6ecdfa13-60cb-4d40-bd4a-9e5712399fed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:02.893135 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6ecdfa13-60cb-4d40-bd4a-9e5712399fed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:02.901456 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ecdfa13-60cb-4d40-bd4a-9e5712399fed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:02.907481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ecdfa13-60cb-4d40-bd4a-9e5712399fed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:02.907964 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ecdfa13-60cb-4d40-bd4a-9e5712399fed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:02.908713 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ecdfa13-60cb-4d40-bd4a-9e5712399fed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:02.909178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ecdfa13-60cb-4d40-bd4a-9e5712399fed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:02.909602 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ecdfa13-60cb-4d40-bd4a-9e5712399fed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:02.934570 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-417d8077-9b79-4cd0-9419-0ba1b9a56246 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:02.935465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-417d8077-9b79-4cd0-9419-0ba1b9a56246 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:02.944643 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-417d8077-9b79-4cd0-9419-0ba1b9a56246 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:02.945163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-417d8077-9b79-4cd0-9419-0ba1b9a56246 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:02.945809 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-417d8077-9b79-4cd0-9419-0ba1b9a56246 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:02.946604 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-417d8077-9b79-4cd0-9419-0ba1b9a56246 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:02.947131 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-417d8077-9b79-4cd0-9419-0ba1b9a56246 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:02.947620 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-417d8077-9b79-4cd0-9419-0ba1b9a56246 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:03.213790 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-417d8077-9b79-4cd0-9419-0ba1b9a56246 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:03.226345 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-417d8077-9b79-4cd0-9419-0ba1b9a56246 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1322 microversion: 2.1 time: 0.295986 Sep 26 05:30:03.227634 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 74/144] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:02 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:03.229617 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6ecdfa13-60cb-4d40-bd4a-9e5712399fed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:03.240269 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6ecdfa13-60cb-4d40-bd4a-9e5712399fed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:03.244091 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6ecdfa13-60cb-4d40-bd4a-9e5712399fed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:03.245277 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6ecdfa13-60cb-4d40-bd4a-9e5712399fed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1407 microversion: 2.20 time: 0.357252 Sep 26 05:30:03.246142 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 71/145] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:30:02 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1407 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:30:03.606845 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-bb1acb87-5436-4949-9961-144fab19031f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:03.607461 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-bb1acb87-5436-4949-9961-144fab19031f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:03.613743 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-bb1acb87-5436-4949-9961-144fab19031f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:03.614242 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-bb1acb87-5436-4949-9961-144fab19031f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:03.614779 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-bb1acb87-5436-4949-9961-144fab19031f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:03.615721 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-bb1acb87-5436-4949-9961-144fab19031f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:03.616371 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-bb1acb87-5436-4949-9961-144fab19031f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:03.617068 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-bb1acb87-5436-4949-9961-144fab19031f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:03.765222 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-bb1acb87-5436-4949-9961-144fab19031f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:03.776698 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-bb1acb87-5436-4949-9961-144fab19031f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1366 microversion: 2.1 time: 0.173566 Sep 26 05:30:03.804551 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 75/146] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:03 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:04.070687 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2770780f-e546-499a-a3ca-1d7e8ec55fcc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38f18411-e077-48af-8c9e-828dd22b20b1"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:30:04.073254 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2770780f-e546-499a-a3ca-1d7e8ec55fcc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:04.096068 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2770780f-e546-499a-a3ca-1d7e8ec55fcc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:04.096588 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2770780f-e546-499a-a3ca-1d7e8ec55fcc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:04.097149 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2770780f-e546-499a-a3ca-1d7e8ec55fcc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:04.098227 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2770780f-e546-499a-a3ca-1d7e8ec55fcc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:04.098974 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2770780f-e546-499a-a3ca-1d7e8ec55fcc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:04.099532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2770780f-e546-499a-a3ca-1d7e8ec55fcc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:04.255356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-caa743ce-8491-4f1f-8443-69619d9bf9d7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:04.256004 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-caa743ce-8491-4f1f-8443-69619d9bf9d7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:04.278639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-caa743ce-8491-4f1f-8443-69619d9bf9d7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:04.279375 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-caa743ce-8491-4f1f-8443-69619d9bf9d7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:04.284706 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-caa743ce-8491-4f1f-8443-69619d9bf9d7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:04.285581 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-caa743ce-8491-4f1f-8443-69619d9bf9d7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:04.286124 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-caa743ce-8491-4f1f-8443-69619d9bf9d7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:04.287098 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-caa743ce-8491-4f1f-8443-69619d9bf9d7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:04.471024 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-caa743ce-8491-4f1f-8443-69619d9bf9d7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:04.489952 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-caa743ce-8491-4f1f-8443-69619d9bf9d7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1515 microversion: 2.1 time: 0.241922 Sep 26 05:30:04.491286 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 76/147] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:04 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1515 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:04.498726 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-beb51138-230b-4e05-8323-c50af3e7e531 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:04.499414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-beb51138-230b-4e05-8323-c50af3e7e531 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:04.506844 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-beb51138-230b-4e05-8323-c50af3e7e531 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:04.507525 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-beb51138-230b-4e05-8323-c50af3e7e531 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:04.507956 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-beb51138-230b-4e05-8323-c50af3e7e531 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:04.508713 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-beb51138-230b-4e05-8323-c50af3e7e531 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:04.509183 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-beb51138-230b-4e05-8323-c50af3e7e531 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:04.509804 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-beb51138-230b-4e05-8323-c50af3e7e531 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:04.651785 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-beb51138-230b-4e05-8323-c50af3e7e531 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:04.662383 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-beb51138-230b-4e05-8323-c50af3e7e531 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:04.663954 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-beb51138-230b-4e05-8323-c50af3e7e531 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:04.665114 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-beb51138-230b-4e05-8323-c50af3e7e531 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1407 microversion: 2.20 time: 0.172475 Sep 26 05:30:04.684279 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 77/148] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:30:04 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:30:04.684279 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-4669d338-6b35-4eca-b9dc-7f04193df8ab tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:30:04.684279 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-4669d338-6b35-4eca-b9dc-7f04193df8ab tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:04.684279 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4669d338-6b35-4eca-b9dc-7f04193df8ab tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:04.684715 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4669d338-6b35-4eca-b9dc-7f04193df8ab tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:04.684934 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4669d338-6b35-4eca-b9dc-7f04193df8ab tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:04.685725 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4669d338-6b35-4eca-b9dc-7f04193df8ab tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:04.686239 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4669d338-6b35-4eca-b9dc-7f04193df8ab tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:04.686657 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4669d338-6b35-4eca-b9dc-7f04193df8ab tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:04.751415 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-4669d338-6b35-4eca-b9dc-7f04193df8ab tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lazy-loading 'flavor' on Instance uuid e6937727-fb89-499b-91ea-fa6b399607f7 {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:30:04.881493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:04.912314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-4669d338-6b35-4eca-b9dc-7f04193df8ab tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "POST /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7/action" status: 200 len: 32 microversion: 2.1 time: 0.242198 Sep 26 05:30:04.912835 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 78/149] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 05:30:04 2022] POST /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7/action => generated 32 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:30:04.923911 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-77fdaae3-d970-4db4-8a83-7a83c31a137f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:04.925277 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-77fdaae3-d970-4db4-8a83-7a83c31a137f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:04.934339 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-77fdaae3-d970-4db4-8a83-7a83c31a137f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:04.934849 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-77fdaae3-d970-4db4-8a83-7a83c31a137f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:04.935276 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-77fdaae3-d970-4db4-8a83-7a83c31a137f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:04.935953 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-77fdaae3-d970-4db4-8a83-7a83c31a137f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:04.936433 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-77fdaae3-d970-4db4-8a83-7a83c31a137f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:04.936853 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-77fdaae3-d970-4db4-8a83-7a83c31a137f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:05.088032 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-77fdaae3-d970-4db4-8a83-7a83c31a137f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:05.102659 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-77fdaae3-d970-4db4-8a83-7a83c31a137f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1366 microversion: 2.1 time: 0.184460 Sep 26 05:30:05.116598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 79/150] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:04 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:05.116598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-0e766bc8-57a4-443b-a8bf-3f6853373107 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:05.116598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-0e766bc8-57a4-443b-a8bf-3f6853373107 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:05.137249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0e766bc8-57a4-443b-a8bf-3f6853373107 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:05.137871 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0e766bc8-57a4-443b-a8bf-3f6853373107 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:05.138855 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0e766bc8-57a4-443b-a8bf-3f6853373107 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:05.140203 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0e766bc8-57a4-443b-a8bf-3f6853373107 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:05.141065 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0e766bc8-57a4-443b-a8bf-3f6853373107 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:05.141751 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0e766bc8-57a4-443b-a8bf-3f6853373107 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:05.312534 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0e766bc8-57a4-443b-a8bf-3f6853373107 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:05.322168 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-0e766bc8-57a4-443b-a8bf-3f6853373107 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.215154 Sep 26 05:30:05.322729 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 80/151] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:05 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:05.693472 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-25db8aca-75d6-41fa-8989-3e54dfdedebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:05.694140 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-25db8aca-75d6-41fa-8989-3e54dfdedebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:05.701206 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-25db8aca-75d6-41fa-8989-3e54dfdedebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:05.701697 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-25db8aca-75d6-41fa-8989-3e54dfdedebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:05.702169 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-25db8aca-75d6-41fa-8989-3e54dfdedebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:05.703200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-25db8aca-75d6-41fa-8989-3e54dfdedebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:05.703788 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-25db8aca-75d6-41fa-8989-3e54dfdedebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:05.704476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-25db8aca-75d6-41fa-8989-3e54dfdedebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:05.878557 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-25db8aca-75d6-41fa-8989-3e54dfdedebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:05.890845 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-25db8aca-75d6-41fa-8989-3e54dfdedebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:05.892462 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-25db8aca-75d6-41fa-8989-3e54dfdedebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:05.894417 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-25db8aca-75d6-41fa-8989-3e54dfdedebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1598 microversion: 2.20 time: 0.207223 Sep 26 05:30:05.914961 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 81/152] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:30:05 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1598 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:30:05.923802 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c53532b8-6113-48ab-ae50-f82a44e9e7ad tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:05.924453 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c53532b8-6113-48ab-ae50-f82a44e9e7ad tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:05.931509 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c53532b8-6113-48ab-ae50-f82a44e9e7ad tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:05.932135 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c53532b8-6113-48ab-ae50-f82a44e9e7ad tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:05.932684 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c53532b8-6113-48ab-ae50-f82a44e9e7ad tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:05.933634 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c53532b8-6113-48ab-ae50-f82a44e9e7ad tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:05.934223 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c53532b8-6113-48ab-ae50-f82a44e9e7ad tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:05.934704 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c53532b8-6113-48ab-ae50-f82a44e9e7ad tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:06.021049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c53532b8-6113-48ab-ae50-f82a44e9e7ad tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101520 Sep 26 05:30:06.022184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 82/153] 10.222.0.49 () {60 vars in 1316 bytes} [Mon Sep 26 05:30:05 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 05:30:06.129977 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d2e83007-9d80-4b03-8d0a-38f34d14469d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:06.131451 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d2e83007-9d80-4b03-8d0a-38f34d14469d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:06.140242 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d2e83007-9d80-4b03-8d0a-38f34d14469d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:06.141147 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d2e83007-9d80-4b03-8d0a-38f34d14469d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:06.141781 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d2e83007-9d80-4b03-8d0a-38f34d14469d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:06.142840 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d2e83007-9d80-4b03-8d0a-38f34d14469d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:06.143706 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d2e83007-9d80-4b03-8d0a-38f34d14469d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:06.144404 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d2e83007-9d80-4b03-8d0a-38f34d14469d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:06.690304 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d2e83007-9d80-4b03-8d0a-38f34d14469d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:06.701697 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d2e83007-9d80-4b03-8d0a-38f34d14469d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1556 microversion: 2.1 time: 0.576798 Sep 26 05:30:06.702534 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 83/154] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:06 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1556 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:06.729993 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6b267cb6-f241-4065-92ff-050dd68f76fc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:06.731117 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6b267cb6-f241-4065-92ff-050dd68f76fc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:06.738895 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b267cb6-f241-4065-92ff-050dd68f76fc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:06.739770 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b267cb6-f241-4065-92ff-050dd68f76fc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:06.740454 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b267cb6-f241-4065-92ff-050dd68f76fc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:06.741469 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b267cb6-f241-4065-92ff-050dd68f76fc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:06.742114 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b267cb6-f241-4065-92ff-050dd68f76fc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:06.742731 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b267cb6-f241-4065-92ff-050dd68f76fc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:07.127824 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6b267cb6-f241-4065-92ff-050dd68f76fc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:07.138761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6b267cb6-f241-4065-92ff-050dd68f76fc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.434246 Sep 26 05:30:07.139334 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 84/155] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:06 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:07.144505 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-95c62787-887c-48d3-83d8-618994572aac tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:07.145881 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-95c62787-887c-48d3-83d8-618994572aac tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:07.157749 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95c62787-887c-48d3-83d8-618994572aac tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:07.160406 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95c62787-887c-48d3-83d8-618994572aac tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:07.161877 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95c62787-887c-48d3-83d8-618994572aac tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:07.166858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95c62787-887c-48d3-83d8-618994572aac tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:07.167350 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95c62787-887c-48d3-83d8-618994572aac tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:07.167783 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95c62787-887c-48d3-83d8-618994572aac tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:07.306457 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-95c62787-887c-48d3-83d8-618994572aac tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.165699 Sep 26 05:30:07.314696 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 85/156] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 05:30:07 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:30:07.874904 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-14181a51-cba7-487a-90eb-628b8ad24e45 req-e626fdbb-2383-474a-8027-25bba8e3c8bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ffa337e-39e1-4edc-9a0d-4468ff05c577", "tag": "db14dfec-952b-46e2-9617-72801c005bb3"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:30:07.885032 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-14181a51-cba7-487a-90eb-628b8ad24e45 req-e626fdbb-2383-474a-8027-25bba8e3c8bd service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:07.886242 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-14181a51-cba7-487a-90eb-628b8ad24e45 req-e626fdbb-2383-474a-8027-25bba8e3c8bd service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:07.886892 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-14181a51-cba7-487a-90eb-628b8ad24e45 req-e626fdbb-2383-474a-8027-25bba8e3c8bd service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:07.907191 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-14181a51-cba7-487a-90eb-628b8ad24e45 req-e626fdbb-2383-474a-8027-25bba8e3c8bd service nova] Creating event network-changed:db14dfec-952b-46e2-9617-72801c005bb3 for instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 on hv-cinder-85918 Sep 26 05:30:07.914121 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-14181a51-cba7-487a-90eb-628b8ad24e45 req-e626fdbb-2383-474a-8027-25bba8e3c8bd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042996 Sep 26 05:30:07.914941 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 86/157] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:30:08.166220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-2a20fff3-9fa7-4438-ae38-fa888bca1f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:08.167269 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-2a20fff3-9fa7-4438-ae38-fa888bca1f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:08.173700 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2a20fff3-9fa7-4438-ae38-fa888bca1f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:08.174518 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2a20fff3-9fa7-4438-ae38-fa888bca1f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:08.175022 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2a20fff3-9fa7-4438-ae38-fa888bca1f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:08.175959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2a20fff3-9fa7-4438-ae38-fa888bca1f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:08.176651 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2a20fff3-9fa7-4438-ae38-fa888bca1f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:08.177146 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2a20fff3-9fa7-4438-ae38-fa888bca1f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:08.333081 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2a20fff3-9fa7-4438-ae38-fa888bca1f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:08.351928 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2a20fff3-9fa7-4438-ae38-fa888bca1f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.180620 Sep 26 05:30:08.368442 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 87/158] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:08 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:30:08.843236 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-60d81c13-d698-48b5-84fd-07425649f55f req-d93ebfef-73a9-47d4-bbe8-8a55a35af55b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149e1a24-0c3f-4697-8982-771b7bbb4215", "tag": "61f405ec-53a2-45d3-97e1-b2c513f8244a"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:30:08.852997 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-60d81c13-d698-48b5-84fd-07425649f55f req-d93ebfef-73a9-47d4-bbe8-8a55a35af55b service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:08.853471 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-60d81c13-d698-48b5-84fd-07425649f55f req-d93ebfef-73a9-47d4-bbe8-8a55a35af55b service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:08.854212 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-60d81c13-d698-48b5-84fd-07425649f55f req-d93ebfef-73a9-47d4-bbe8-8a55a35af55b service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:08.868720 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-60d81c13-d698-48b5-84fd-07425649f55f req-d93ebfef-73a9-47d4-bbe8-8a55a35af55b service nova] Creating event network-changed:61f405ec-53a2-45d3-97e1-b2c513f8244a for instance 149e1a24-0c3f-4697-8982-771b7bbb4215 on hv-cinder-85918 Sep 26 05:30:08.874075 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-60d81c13-d698-48b5-84fd-07425649f55f req-d93ebfef-73a9-47d4-bbe8-8a55a35af55b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034890 Sep 26 05:30:08.875212 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 88/159] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:30:09.376668 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7df1fc8e-39c6-451b-b2cc-751af55eecfb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:09.378126 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7df1fc8e-39c6-451b-b2cc-751af55eecfb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:09.386557 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7df1fc8e-39c6-451b-b2cc-751af55eecfb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:09.387358 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7df1fc8e-39c6-451b-b2cc-751af55eecfb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:09.388016 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7df1fc8e-39c6-451b-b2cc-751af55eecfb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:09.389289 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7df1fc8e-39c6-451b-b2cc-751af55eecfb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:09.389945 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7df1fc8e-39c6-451b-b2cc-751af55eecfb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:09.390432 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7df1fc8e-39c6-451b-b2cc-751af55eecfb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:09.562577 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7df1fc8e-39c6-451b-b2cc-751af55eecfb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:09.575128 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7df1fc8e-39c6-451b-b2cc-751af55eecfb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.203668 Sep 26 05:30:09.575724 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 89/160] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:09 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:30:10.570666 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2770780f-e546-499a-a3ca-1d7e8ec55fcc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "POST /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.505079 Sep 26 05:30:10.577122 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 72/161] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 05:30:04 2022] POST /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce/os-volume_attachments => generated 194 bytes in 6512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:30:10.611371 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a6c8a63f-d256-4921-a261-812cbc824299 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:10.616897 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a6c8a63f-d256-4921-a261-812cbc824299 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:10.627376 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6c8a63f-d256-4921-a261-812cbc824299 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:10.629320 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6c8a63f-d256-4921-a261-812cbc824299 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:10.630113 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6c8a63f-d256-4921-a261-812cbc824299 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:10.633385 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6c8a63f-d256-4921-a261-812cbc824299 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:10.634022 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6c8a63f-d256-4921-a261-812cbc824299 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:10.634595 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6c8a63f-d256-4921-a261-812cbc824299 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:10.820801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a6c8a63f-d256-4921-a261-812cbc824299 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:10.830996 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a6c8a63f-d256-4921-a261-812cbc824299 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.233851 Sep 26 05:30:10.831647 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 90/162] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:10 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:11.859272 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-953de982-f1d2-4f50-bf75-9ba6218bbd74 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:11.860112 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-953de982-f1d2-4f50-bf75-9ba6218bbd74 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:11.861982 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=91 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:11.868046 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-953de982-f1d2-4f50-bf75-9ba6218bbd74 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:11.868548 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-953de982-f1d2-4f50-bf75-9ba6218bbd74 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:11.868981 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-953de982-f1d2-4f50-bf75-9ba6218bbd74 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:11.869666 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-953de982-f1d2-4f50-bf75-9ba6218bbd74 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:11.870114 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-953de982-f1d2-4f50-bf75-9ba6218bbd74 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:11.870533 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-953de982-f1d2-4f50-bf75-9ba6218bbd74 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:12.011078 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-953de982-f1d2-4f50-bf75-9ba6218bbd74 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:12.018713 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-953de982-f1d2-4f50-bf75-9ba6218bbd74 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.164981 Sep 26 05:30:12.019297 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 73/163] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:11 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:13.041723 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a0190c5d-909a-4fd9-be99-6c90d4428955 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:13.042347 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a0190c5d-909a-4fd9-be99-6c90d4428955 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:13.048357 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a0190c5d-909a-4fd9-be99-6c90d4428955 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:13.048848 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a0190c5d-909a-4fd9-be99-6c90d4428955 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:13.049298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a0190c5d-909a-4fd9-be99-6c90d4428955 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:13.049992 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a0190c5d-909a-4fd9-be99-6c90d4428955 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:13.050542 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a0190c5d-909a-4fd9-be99-6c90d4428955 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:13.051230 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a0190c5d-909a-4fd9-be99-6c90d4428955 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:13.185061 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a0190c5d-909a-4fd9-be99-6c90d4428955 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:13.193574 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a0190c5d-909a-4fd9-be99-6c90d4428955 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.155909 Sep 26 05:30:13.194130 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 91/164] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:13 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:14.229932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-468e9f07-bcfa-480f-b5b0-13e68d9ad4cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:14.230553 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-468e9f07-bcfa-480f-b5b0-13e68d9ad4cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:14.237775 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-468e9f07-bcfa-480f-b5b0-13e68d9ad4cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:14.238831 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-468e9f07-bcfa-480f-b5b0-13e68d9ad4cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:14.239270 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-468e9f07-bcfa-480f-b5b0-13e68d9ad4cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:14.239983 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-468e9f07-bcfa-480f-b5b0-13e68d9ad4cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:14.240555 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-468e9f07-bcfa-480f-b5b0-13e68d9ad4cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:14.240884 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-468e9f07-bcfa-480f-b5b0-13e68d9ad4cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:14.446797 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-468e9f07-bcfa-480f-b5b0-13e68d9ad4cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:14.454885 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-468e9f07-bcfa-480f-b5b0-13e68d9ad4cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.242111 Sep 26 05:30:14.455449 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 74/165] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:14 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:15.478361 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-23d9af44-3eb9-43e1-ac5a-755ee70f8813 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:15.479078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-23d9af44-3eb9-43e1-ac5a-755ee70f8813 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:15.486864 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-23d9af44-3eb9-43e1-ac5a-755ee70f8813 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:15.487357 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-23d9af44-3eb9-43e1-ac5a-755ee70f8813 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:15.488624 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-23d9af44-3eb9-43e1-ac5a-755ee70f8813 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:15.489335 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-23d9af44-3eb9-43e1-ac5a-755ee70f8813 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:15.489803 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-23d9af44-3eb9-43e1-ac5a-755ee70f8813 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:15.490235 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-23d9af44-3eb9-43e1-ac5a-755ee70f8813 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:15.629453 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-23d9af44-3eb9-43e1-ac5a-755ee70f8813 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:15.637357 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-23d9af44-3eb9-43e1-ac5a-755ee70f8813 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.162882 Sep 26 05:30:15.638089 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 92/166] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:15 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:16.660064 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7d76e51c-4c12-4c35-a609-6d10a58fe4dd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:16.660703 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7d76e51c-4c12-4c35-a609-6d10a58fe4dd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:16.667127 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d76e51c-4c12-4c35-a609-6d10a58fe4dd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:16.667606 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d76e51c-4c12-4c35-a609-6d10a58fe4dd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:16.668035 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d76e51c-4c12-4c35-a609-6d10a58fe4dd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:16.668742 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d76e51c-4c12-4c35-a609-6d10a58fe4dd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:16.669190 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d76e51c-4c12-4c35-a609-6d10a58fe4dd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:16.669614 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d76e51c-4c12-4c35-a609-6d10a58fe4dd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:16.791559 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7d76e51c-4c12-4c35-a609-6d10a58fe4dd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:16.799322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7d76e51c-4c12-4c35-a609-6d10a58fe4dd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.143144 Sep 26 05:30:16.799889 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 75/167] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:16 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:17.823440 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-fae4cc0f-a78c-4d06-96ec-1e21b136dc3e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:17.824211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-fae4cc0f-a78c-4d06-96ec-1e21b136dc3e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:17.832064 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fae4cc0f-a78c-4d06-96ec-1e21b136dc3e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:17.832783 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fae4cc0f-a78c-4d06-96ec-1e21b136dc3e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:17.833234 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fae4cc0f-a78c-4d06-96ec-1e21b136dc3e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:17.833909 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fae4cc0f-a78c-4d06-96ec-1e21b136dc3e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:17.834379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fae4cc0f-a78c-4d06-96ec-1e21b136dc3e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:17.834803 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fae4cc0f-a78c-4d06-96ec-1e21b136dc3e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:18.242834 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-fae4cc0f-a78c-4d06-96ec-1e21b136dc3e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:18.250599 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-fae4cc0f-a78c-4d06-96ec-1e21b136dc3e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.432036 Sep 26 05:30:18.251168 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 93/168] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:17 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:19.273895 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bd32d5b1-96c2-46d2-b586-f78630475d59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:19.274506 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bd32d5b1-96c2-46d2-b586-f78630475d59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:19.280856 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bd32d5b1-96c2-46d2-b586-f78630475d59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:19.281336 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bd32d5b1-96c2-46d2-b586-f78630475d59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:19.281846 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bd32d5b1-96c2-46d2-b586-f78630475d59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:19.282533 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bd32d5b1-96c2-46d2-b586-f78630475d59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:19.282982 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bd32d5b1-96c2-46d2-b586-f78630475d59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:19.283398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bd32d5b1-96c2-46d2-b586-f78630475d59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:19.422301 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bd32d5b1-96c2-46d2-b586-f78630475d59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:19.426151 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:19.433339 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bd32d5b1-96c2-46d2-b586-f78630475d59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.163428 Sep 26 05:30:19.434088 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 76/169] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:19 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:20.460289 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-fdaaa839-c80c-4b31-9a1e-927f455ca798 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:20.460886 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-fdaaa839-c80c-4b31-9a1e-927f455ca798 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:20.464463 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=82 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:20.470132 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fdaaa839-c80c-4b31-9a1e-927f455ca798 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:20.471526 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fdaaa839-c80c-4b31-9a1e-927f455ca798 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:20.472413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fdaaa839-c80c-4b31-9a1e-927f455ca798 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:20.473838 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fdaaa839-c80c-4b31-9a1e-927f455ca798 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:20.474690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fdaaa839-c80c-4b31-9a1e-927f455ca798 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:20.475107 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fdaaa839-c80c-4b31-9a1e-927f455ca798 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:20.624825 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-fdaaa839-c80c-4b31-9a1e-927f455ca798 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:20.633545 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-fdaaa839-c80c-4b31-9a1e-927f455ca798 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.178705 Sep 26 05:30:20.634245 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 94/170] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:20 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:21.664941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9ea65101-94b3-4d6d-8566-b88919669cc0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:21.665615 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9ea65101-94b3-4d6d-8566-b88919669cc0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:21.680956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9ea65101-94b3-4d6d-8566-b88919669cc0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:21.681838 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9ea65101-94b3-4d6d-8566-b88919669cc0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:21.682505 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9ea65101-94b3-4d6d-8566-b88919669cc0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:21.683432 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9ea65101-94b3-4d6d-8566-b88919669cc0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:21.684086 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9ea65101-94b3-4d6d-8566-b88919669cc0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:21.684757 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9ea65101-94b3-4d6d-8566-b88919669cc0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:21.961672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9ea65101-94b3-4d6d-8566-b88919669cc0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:21.971773 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9ea65101-94b3-4d6d-8566-b88919669cc0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.312274 Sep 26 05:30:21.977633 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 77/171] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:21 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:23.003199 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-35e058e2-9e3c-4239-b925-ffd98ad9fe5f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:23.004046 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-35e058e2-9e3c-4239-b925-ffd98ad9fe5f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:23.013581 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-35e058e2-9e3c-4239-b925-ffd98ad9fe5f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:23.014199 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-35e058e2-9e3c-4239-b925-ffd98ad9fe5f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:23.014713 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-35e058e2-9e3c-4239-b925-ffd98ad9fe5f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:23.015777 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-35e058e2-9e3c-4239-b925-ffd98ad9fe5f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:23.016338 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-35e058e2-9e3c-4239-b925-ffd98ad9fe5f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:23.017221 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-35e058e2-9e3c-4239-b925-ffd98ad9fe5f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:23.197829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-35e058e2-9e3c-4239-b925-ffd98ad9fe5f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:23.207530 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-35e058e2-9e3c-4239-b925-ffd98ad9fe5f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.209126 Sep 26 05:30:23.219382 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 95/172] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:22 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:24.231744 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-98064238-d656-4589-a9a4-0ea727eaf42c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:24.232905 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-98064238-d656-4589-a9a4-0ea727eaf42c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:24.246909 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98064238-d656-4589-a9a4-0ea727eaf42c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:24.247594 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98064238-d656-4589-a9a4-0ea727eaf42c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:24.248217 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98064238-d656-4589-a9a4-0ea727eaf42c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:24.249118 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98064238-d656-4589-a9a4-0ea727eaf42c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:24.249739 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98064238-d656-4589-a9a4-0ea727eaf42c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:24.250313 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98064238-d656-4589-a9a4-0ea727eaf42c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:24.586318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-98064238-d656-4589-a9a4-0ea727eaf42c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:24.594946 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-98064238-d656-4589-a9a4-0ea727eaf42c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.367666 Sep 26 05:30:24.605006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 78/173] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:24 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:25.634294 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-93337ea3-fd92-4fd8-b9fc-526cdb1b97e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:25.636964 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-93337ea3-fd92-4fd8-b9fc-526cdb1b97e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:25.647133 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-93337ea3-fd92-4fd8-b9fc-526cdb1b97e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:25.648298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-93337ea3-fd92-4fd8-b9fc-526cdb1b97e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:25.648793 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-93337ea3-fd92-4fd8-b9fc-526cdb1b97e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:25.667352 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-93337ea3-fd92-4fd8-b9fc-526cdb1b97e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:25.667352 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-93337ea3-fd92-4fd8-b9fc-526cdb1b97e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:25.667352 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-93337ea3-fd92-4fd8-b9fc-526cdb1b97e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:26.066821 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-93337ea3-fd92-4fd8-b9fc-526cdb1b97e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:26.082444 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-93337ea3-fd92-4fd8-b9fc-526cdb1b97e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.454218 Sep 26 05:30:26.085386 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 96/174] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:25 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:27.118088 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a517eaa8-1ed7-4028-b3a8-c19515e5f680 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:27.119418 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a517eaa8-1ed7-4028-b3a8-c19515e5f680 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:27.133133 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a517eaa8-1ed7-4028-b3a8-c19515e5f680 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:27.133898 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a517eaa8-1ed7-4028-b3a8-c19515e5f680 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:27.134696 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a517eaa8-1ed7-4028-b3a8-c19515e5f680 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:27.136101 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a517eaa8-1ed7-4028-b3a8-c19515e5f680 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:27.136744 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a517eaa8-1ed7-4028-b3a8-c19515e5f680 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:27.139926 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a517eaa8-1ed7-4028-b3a8-c19515e5f680 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:28.133715 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a517eaa8-1ed7-4028-b3a8-c19515e5f680 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:28.151245 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a517eaa8-1ed7-4028-b3a8-c19515e5f680 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 1.037761 Sep 26 05:30:28.169821 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 79/175] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:27 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:28.296065 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c923b107-c0d2-44a3-b4e1-fc0f69ed1fa1 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:28.296618 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c923b107-c0d2-44a3-b4e1-fc0f69ed1fa1 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:28.306222 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c923b107-c0d2-44a3-b4e1-fc0f69ed1fa1 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:28.306814 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c923b107-c0d2-44a3-b4e1-fc0f69ed1fa1 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:28.307251 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c923b107-c0d2-44a3-b4e1-fc0f69ed1fa1 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:28.307958 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c923b107-c0d2-44a3-b4e1-fc0f69ed1fa1 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:28.308440 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c923b107-c0d2-44a3-b4e1-fc0f69ed1fa1 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:28.308864 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c923b107-c0d2-44a3-b4e1-fc0f69ed1fa1 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:28.339035 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:28.409306 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c923b107-c0d2-44a3-b4e1-fc0f69ed1fa1 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Going to try to terminate instance {{(pid=120806) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:30:28.656180 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c923b107-c0d2-44a3-b4e1-fc0f69ed1fa1 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 204 len: 0 microversion: 2.1 time: 0.362751 Sep 26 05:30:28.657681 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 97/176] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:30:28 2022] DELETE /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:28.667785 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bb35ba18-cc1d-445d-a54c-98f120a687c3 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:28.668473 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bb35ba18-cc1d-445d-a54c-98f120a687c3 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:28.682426 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bb35ba18-cc1d-445d-a54c-98f120a687c3 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:28.683125 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bb35ba18-cc1d-445d-a54c-98f120a687c3 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:28.683796 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bb35ba18-cc1d-445d-a54c-98f120a687c3 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:28.685319 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bb35ba18-cc1d-445d-a54c-98f120a687c3 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:28.685999 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bb35ba18-cc1d-445d-a54c-98f120a687c3 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:28.686567 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bb35ba18-cc1d-445d-a54c-98f120a687c3 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:29.022953 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bb35ba18-cc1d-445d-a54c-98f120a687c3 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:29.039532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bb35ba18-cc1d-445d-a54c-98f120a687c3 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1552 microversion: 2.1 time: 0.376648 Sep 26 05:30:29.040975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 80/177] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:28 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1552 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:29.178275 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a351703b-a172-4b0d-af6f-18482d6026d8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:29.179781 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a351703b-a172-4b0d-af6f-18482d6026d8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:29.208694 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a351703b-a172-4b0d-af6f-18482d6026d8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:29.210862 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a351703b-a172-4b0d-af6f-18482d6026d8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:29.211782 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a351703b-a172-4b0d-af6f-18482d6026d8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:29.213331 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a351703b-a172-4b0d-af6f-18482d6026d8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:29.214183 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a351703b-a172-4b0d-af6f-18482d6026d8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:29.216492 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a351703b-a172-4b0d-af6f-18482d6026d8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:29.666645 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a351703b-a172-4b0d-af6f-18482d6026d8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:29.677166 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a351703b-a172-4b0d-af6f-18482d6026d8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.504687 Sep 26 05:30:29.677909 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 98/178] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:29 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:30.070650 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-839db33d-d2e5-4fb6-a524-550cff907d65 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:30.071527 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-839db33d-d2e5-4fb6-a524-550cff907d65 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:30.080803 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-839db33d-d2e5-4fb6-a524-550cff907d65 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:30.083822 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-839db33d-d2e5-4fb6-a524-550cff907d65 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:30.085929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-839db33d-d2e5-4fb6-a524-550cff907d65 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:30.086841 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-839db33d-d2e5-4fb6-a524-550cff907d65 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:30.087612 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-839db33d-d2e5-4fb6-a524-550cff907d65 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:30.088281 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-839db33d-d2e5-4fb6-a524-550cff907d65 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:30.373035 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-839db33d-d2e5-4fb6-a524-550cff907d65 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:30.399887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-839db33d-d2e5-4fb6-a524-550cff907d65 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1552 microversion: 2.1 time: 0.331311 Sep 26 05:30:30.400755 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 81/179] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:30 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1552 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:30.700873 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-abd14c8d-ba66-4459-9ad4-8f6759874023 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:30.701923 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-abd14c8d-ba66-4459-9ad4-8f6759874023 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:30.708389 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-abd14c8d-ba66-4459-9ad4-8f6759874023 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:30.709174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-abd14c8d-ba66-4459-9ad4-8f6759874023 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:30.709841 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-abd14c8d-ba66-4459-9ad4-8f6759874023 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:30.710743 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-abd14c8d-ba66-4459-9ad4-8f6759874023 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:30.711493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-abd14c8d-ba66-4459-9ad4-8f6759874023 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:30.712111 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-abd14c8d-ba66-4459-9ad4-8f6759874023 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:30.907931 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-abd14c8d-ba66-4459-9ad4-8f6759874023 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:30.921777 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-abd14c8d-ba66-4459-9ad4-8f6759874023 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.222876 Sep 26 05:30:30.924103 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 99/180] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:30 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:31.424024 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7d23c767-bd39-4588-aa03-fa3de3029f33 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:31.425359 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7d23c767-bd39-4588-aa03-fa3de3029f33 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:31.434218 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d23c767-bd39-4588-aa03-fa3de3029f33 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:31.435013 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d23c767-bd39-4588-aa03-fa3de3029f33 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:31.436219 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d23c767-bd39-4588-aa03-fa3de3029f33 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:31.437160 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d23c767-bd39-4588-aa03-fa3de3029f33 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:31.437957 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d23c767-bd39-4588-aa03-fa3de3029f33 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:31.438584 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d23c767-bd39-4588-aa03-fa3de3029f33 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:31.628296 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7d23c767-bd39-4588-aa03-fa3de3029f33 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:31.652456 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7d23c767-bd39-4588-aa03-fa3de3029f33 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1552 microversion: 2.1 time: 0.232873 Sep 26 05:30:31.653355 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 82/181] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:31 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1552 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:31.947359 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a0dcefe5-bd3f-4a91-ae63-ad06a44af5ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:31.948700 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a0dcefe5-bd3f-4a91-ae63-ad06a44af5ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:31.957740 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a0dcefe5-bd3f-4a91-ae63-ad06a44af5ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:31.958767 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a0dcefe5-bd3f-4a91-ae63-ad06a44af5ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:31.959198 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a0dcefe5-bd3f-4a91-ae63-ad06a44af5ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:31.961337 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a0dcefe5-bd3f-4a91-ae63-ad06a44af5ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:31.961923 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a0dcefe5-bd3f-4a91-ae63-ad06a44af5ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:31.962347 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a0dcefe5-bd3f-4a91-ae63-ad06a44af5ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:32.529664 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a0dcefe5-bd3f-4a91-ae63-ad06a44af5ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:32.544405 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a0dcefe5-bd3f-4a91-ae63-ad06a44af5ed tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.601606 Sep 26 05:30:32.545984 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 100/182] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:31 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:32.690262 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9a04f435-b6c0-4bdb-9ae3-dd7ab798f078 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:32.691144 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9a04f435-b6c0-4bdb-9ae3-dd7ab798f078 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:32.713304 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9a04f435-b6c0-4bdb-9ae3-dd7ab798f078 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:32.714223 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9a04f435-b6c0-4bdb-9ae3-dd7ab798f078 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:32.714945 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9a04f435-b6c0-4bdb-9ae3-dd7ab798f078 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:32.715905 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9a04f435-b6c0-4bdb-9ae3-dd7ab798f078 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:32.716534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9a04f435-b6c0-4bdb-9ae3-dd7ab798f078 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:32.717225 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9a04f435-b6c0-4bdb-9ae3-dd7ab798f078 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:33.006737 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9a04f435-b6c0-4bdb-9ae3-dd7ab798f078 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:33.023974 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9a04f435-b6c0-4bdb-9ae3-dd7ab798f078 tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1552 microversion: 2.1 time: 0.348404 Sep 26 05:30:33.028485 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 83/183] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:32 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1552 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:33.410962 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-7fd40822-bb68-4d2f-b630-482ff6d084c5 req-da5e6111-6c95-46f0-814e-dc9a7c82c4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a31a978e-d8fb-4412-ad8c-999a3f18cfce", "name": "network-vif-deleted", "tag": "700f3c7c-ee4f-426b-9bf3-1e03b2102f81"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:30:33.437758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-7fd40822-bb68-4d2f-b630-482ff6d084c5 req-da5e6111-6c95-46f0-814e-dc9a7c82c4f4 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:33.441831 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-7fd40822-bb68-4d2f-b630-482ff6d084c5 req-da5e6111-6c95-46f0-814e-dc9a7c82c4f4 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:33.442652 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-7fd40822-bb68-4d2f-b630-482ff6d084c5 req-da5e6111-6c95-46f0-814e-dc9a7c82c4f4 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:33.467519 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-7fd40822-bb68-4d2f-b630-482ff6d084c5 req-da5e6111-6c95-46f0-814e-dc9a7c82c4f4 service nova] Creating event network-vif-deleted:700f3c7c-ee4f-426b-9bf3-1e03b2102f81 for instance a31a978e-d8fb-4412-ad8c-999a3f18cfce on hv-cinder-85918 Sep 26 05:30:33.488049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-7fd40822-bb68-4d2f-b630-482ff6d084c5 req-da5e6111-6c95-46f0-814e-dc9a7c82c4f4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081353 Sep 26 05:30:33.493674 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 101/184] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:30:33.571412 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f7d340f8-dc80-4ea8-9b70-9f48ef051f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:33.572870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f7d340f8-dc80-4ea8-9b70-9f48ef051f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:33.585303 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7d340f8-dc80-4ea8-9b70-9f48ef051f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:33.587651 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7d340f8-dc80-4ea8-9b70-9f48ef051f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:33.588935 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7d340f8-dc80-4ea8-9b70-9f48ef051f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:33.592439 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7d340f8-dc80-4ea8-9b70-9f48ef051f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:33.593460 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7d340f8-dc80-4ea8-9b70-9f48ef051f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:33.595232 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7d340f8-dc80-4ea8-9b70-9f48ef051f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:33.853284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f7d340f8-dc80-4ea8-9b70-9f48ef051f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:33.869612 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f7d340f8-dc80-4ea8-9b70-9f48ef051f1e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.302380 Sep 26 05:30:33.885135 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 84/185] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:33 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:34.063120 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-fa2bcb24-8599-41d0-9abf-670d69fd9fbc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:34.063851 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-fa2bcb24-8599-41d0-9abf-670d69fd9fbc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:34.078855 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fa2bcb24-8599-41d0-9abf-670d69fd9fbc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:34.086116 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fa2bcb24-8599-41d0-9abf-670d69fd9fbc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:34.086708 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fa2bcb24-8599-41d0-9abf-670d69fd9fbc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:34.087978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fa2bcb24-8599-41d0-9abf-670d69fd9fbc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:34.088518 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fa2bcb24-8599-41d0-9abf-670d69fd9fbc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:34.088899 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fa2bcb24-8599-41d0-9abf-670d69fd9fbc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:34.180346 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fa2bcb24-8599-41d0-9abf-670d69fd9fbc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:34.181134 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fa2bcb24-8599-41d0-9abf-670d69fd9fbc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:34.181815 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fa2bcb24-8599-41d0-9abf-670d69fd9fbc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:34.182460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-fa2bcb24-8599-41d0-9abf-670d69fd9fbc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lazy-loading 'fault' on Instance uuid a31a978e-d8fb-4412-ad8c-999a3f18cfce {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:30:34.321463 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-fa2bcb24-8599-41d0-9abf-670d69fd9fbc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4056ea3d1a1d48f2a34e14df77914363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a676eb5cbd74956ba12b1d5595e3f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:34.341996 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-fa2bcb24-8599-41d0-9abf-670d69fd9fbc tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 200 len: 1350 microversion: 2.1 time: 0.292082 Sep 26 05:30:34.343568 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 102/186] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:34 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 1350 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:34.898109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7c4d8e8a-2e89-4a9d-a6dd-5e8cd59f056e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:34.898994 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7c4d8e8a-2e89-4a9d-a6dd-5e8cd59f056e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:34.922973 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c4d8e8a-2e89-4a9d-a6dd-5e8cd59f056e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:34.923540 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c4d8e8a-2e89-4a9d-a6dd-5e8cd59f056e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:34.924157 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c4d8e8a-2e89-4a9d-a6dd-5e8cd59f056e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:34.925087 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c4d8e8a-2e89-4a9d-a6dd-5e8cd59f056e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:34.926125 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c4d8e8a-2e89-4a9d-a6dd-5e8cd59f056e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:34.927083 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c4d8e8a-2e89-4a9d-a6dd-5e8cd59f056e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:35.368463 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-74cad47d-5036-4908-b3f3-1c4d8f24510d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:35.370227 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-74cad47d-5036-4908-b3f3-1c4d8f24510d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:35.377877 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-74cad47d-5036-4908-b3f3-1c4d8f24510d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:35.378669 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-74cad47d-5036-4908-b3f3-1c4d8f24510d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:35.379321 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-74cad47d-5036-4908-b3f3-1c4d8f24510d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:35.380152 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-74cad47d-5036-4908-b3f3-1c4d8f24510d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:35.380709 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-74cad47d-5036-4908-b3f3-1c4d8f24510d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:35.381280 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-74cad47d-5036-4908-b3f3-1c4d8f24510d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:35.406370 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-74cad47d-5036-4908-b3f3-1c4d8f24510d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] HTTP exception thrown: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-74cad47d-5036-4908-b3f3-1c4d8f24510d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Request method failure captured: Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce HTTP/1.1 Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTitbHeYeGmFJFAfaqtKnc22MYo3lp4Jnb6Pu0b8Cixgjt6p1gb7-PB700pknEYbzYE-3uhx9AveStPQ3Vb-WEIUHXKTUGhVd3koaACKYSY_0f7Exc1ihyahdeAhHqwHoT9-SsEbXpDtmj45KllZugJBpgR-8ByOSj348JpDHE4od1I Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: 0a676eb5cbd74956ba12b1d5595e3f18 Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-DeleteServersTestJSON-234650801 Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:30:35.419104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:30:35.420476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0a676eb5cbd74956ba12b1d5595e3f18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a676eb5cbd74956ba12b1d5595e3f18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a676eb5cbd74956ba12b1d5595e3f18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0a676eb5cbd74956ba12b1d5595e3f18"}]}] Sep 26 05:30:35.420476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-DeleteServersTestJSON-234650801 Sep 26 05:30:35.420476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: 0a676eb5cbd74956ba12b1d5595e3f18 Sep 26 05:30:35.420476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-DeleteServersTestJSON-234650801 Sep 26 05:30:35.420476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-DeleteServersTestJSON-234650801-project Sep 26 05:30:35.420476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:30:35.420476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:30:35.420476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 4056ea3d1a1d48f2a34e14df77914363 Sep 26 05:30:35.420476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-DeleteServersTestJSON-234650801-project Sep 26 05:30:35.420476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:30:35.420476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:35.420476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': 'a31a978e-d8fb-4412-ad8c-999a3f18cfce'} Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:30:35.421162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:30:35.422303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:30:35.422303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:30:35.422303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:30:35.422303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:30:35.422303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:30:35.422303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:30:35.422303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:30:35.422303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:35.422303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:30:35.422303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:30:35.422303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:30:35.422303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:30:35.422303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:30:35.422303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:30:35.422303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:30:35.422303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:30:35.422303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:35.422303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:30:35.425345 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-74cad47d-5036-4908-b3f3-1c4d8f24510d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Returning 404 to user: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:30:35.427336 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-74cad47d-5036-4908-b3f3-1c4d8f24510d tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 404 len: 111 microversion: 2.1 time: 0.063154 Sep 26 05:30:35.428510 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 103/187] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:35 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:30:35.603068 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3650f923-72dc-42cb-832c-1c5b793b111e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:35.607181 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-3650f923-72dc-42cb-832c-1c5b793b111e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:35.630956 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3650f923-72dc-42cb-832c-1c5b793b111e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:35.631567 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3650f923-72dc-42cb-832c-1c5b793b111e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:35.632947 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3650f923-72dc-42cb-832c-1c5b793b111e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:35.636842 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3650f923-72dc-42cb-832c-1c5b793b111e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:35.637336 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3650f923-72dc-42cb-832c-1c5b793b111e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:35.637774 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3650f923-72dc-42cb-832c-1c5b793b111e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:35.689136 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-3650f923-72dc-42cb-832c-1c5b793b111e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] HTTP exception thrown: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3650f923-72dc-42cb-832c-1c5b793b111e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Request method failure captured: Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce/os-volume_attachments HTTP/1.1 Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTitbHeYeGmFJFAfaqtKnc22MYo3lp4Jnb6Pu0b8Cixgjt6p1gb7-PB700pknEYbzYE-3uhx9AveStPQ3Vb-WEIUHXKTUGhVd3koaACKYSY_0f7Exc1ihyahdeAhHqwHoT9-SsEbXpDtmj45KllZugJBpgR-8ByOSj348JpDHE4od1I Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: 0a676eb5cbd74956ba12b1d5595e3f18 Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-DeleteServersTestJSON-234650801 Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:30:35.701441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:30:35.702872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0a676eb5cbd74956ba12b1d5595e3f18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a676eb5cbd74956ba12b1d5595e3f18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a676eb5cbd74956ba12b1d5595e3f18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0a676eb5cbd74956ba12b1d5595e3f18"}]}] Sep 26 05:30:35.702872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-DeleteServersTestJSON-234650801 Sep 26 05:30:35.702872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: 0a676eb5cbd74956ba12b1d5595e3f18 Sep 26 05:30:35.702872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-DeleteServersTestJSON-234650801 Sep 26 05:30:35.702872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-DeleteServersTestJSON-234650801-project Sep 26 05:30:35.702872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:30:35.702872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:30:35.702872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 4056ea3d1a1d48f2a34e14df77914363 Sep 26 05:30:35.702872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-DeleteServersTestJSON-234650801-project Sep 26 05:30:35.702872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:30:35.702872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:35.702872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'server_id': 'a31a978e-d8fb-4412-ad8c-999a3f18cfce'} Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:30:35.703544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:35.705325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:30:35.706523 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3650f923-72dc-42cb-832c-1c5b793b111e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Returning 404 to user: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:30:35.706523 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-3650f923-72dc-42cb-832c-1c5b793b111e tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.105190 Sep 26 05:30:35.708424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 104/188] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:30:35 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce/os-volume_attachments => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:30:35.838255 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7c4d8e8a-2e89-4a9d-a6dd-5e8cd59f056e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:35.851407 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7c4d8e8a-2e89-4a9d-a6dd-5e8cd59f056e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.957411 Sep 26 05:30:35.852815 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 85/189] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:34 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:36.883362 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f85d82fa-0b5a-4f19-b7b8-13500d69aa9a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:36.885279 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f85d82fa-0b5a-4f19-b7b8-13500d69aa9a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:36.913394 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f85d82fa-0b5a-4f19-b7b8-13500d69aa9a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:36.914700 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f85d82fa-0b5a-4f19-b7b8-13500d69aa9a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:36.918317 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f85d82fa-0b5a-4f19-b7b8-13500d69aa9a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:36.919326 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f85d82fa-0b5a-4f19-b7b8-13500d69aa9a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:36.921338 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f85d82fa-0b5a-4f19-b7b8-13500d69aa9a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:36.922030 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f85d82fa-0b5a-4f19-b7b8-13500d69aa9a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:37.283651 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a343fe56-6308-4e31-94b2-57568b8afd8a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:37.285146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a343fe56-6308-4e31-94b2-57568b8afd8a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:37.295827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a343fe56-6308-4e31-94b2-57568b8afd8a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:37.296375 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a343fe56-6308-4e31-94b2-57568b8afd8a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:37.298963 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a343fe56-6308-4e31-94b2-57568b8afd8a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:37.304382 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a343fe56-6308-4e31-94b2-57568b8afd8a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:37.305728 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a343fe56-6308-4e31-94b2-57568b8afd8a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:37.306748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a343fe56-6308-4e31-94b2-57568b8afd8a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:37.332373 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-a343fe56-6308-4e31-94b2-57568b8afd8a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] HTTP exception thrown: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a343fe56-6308-4e31-94b2-57568b8afd8a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Request method failure captured: Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: DELETE /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce HTTP/1.1 Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTitbHeYeGmFJFAfaqtKnc22MYo3lp4Jnb6Pu0b8Cixgjt6p1gb7-PB700pknEYbzYE-3uhx9AveStPQ3Vb-WEIUHXKTUGhVd3koaACKYSY_0f7Exc1ihyahdeAhHqwHoT9-SsEbXpDtmj45KllZugJBpgR-8ByOSj348JpDHE4od1I Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: 0a676eb5cbd74956ba12b1d5595e3f18 Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-DeleteServersTestJSON-234650801 Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:30:37.342720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:30:37.344292 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0a676eb5cbd74956ba12b1d5595e3f18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a676eb5cbd74956ba12b1d5595e3f18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a676eb5cbd74956ba12b1d5595e3f18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0a676eb5cbd74956ba12b1d5595e3f18"}]}] Sep 26 05:30:37.344292 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-DeleteServersTestJSON-234650801 Sep 26 05:30:37.344292 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 0a676eb5cbd74956ba12b1d5595e3f18 Sep 26 05:30:37.344292 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-DeleteServersTestJSON-234650801 Sep 26 05:30:37.344292 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-DeleteServersTestJSON-234650801-project Sep 26 05:30:37.344292 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:30:37.344292 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:30:37.344292 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 4056ea3d1a1d48f2a34e14df77914363 Sep 26 05:30:37.344292 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-DeleteServersTestJSON-234650801-project Sep 26 05:30:37.344292 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:30:37.344292 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:37.344292 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': 'a31a978e-d8fb-4412-ad8c-999a3f18cfce'} Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:30:37.345169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:37.346565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:30:37.350182 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a343fe56-6308-4e31-94b2-57568b8afd8a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Returning 404 to user: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:30:37.352541 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a343fe56-6308-4e31-94b2-57568b8afd8a tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 404 len: 111 microversion: 2.1 time: 0.073167 Sep 26 05:30:37.353638 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 86/190] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:30:37 2022] DELETE /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:30:37.365814 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a358c357-0323-442d-acdb-9b6357f653fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:37.367636 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a358c357-0323-442d-acdb-9b6357f653fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] [instance: a31a978e-d8fb-4412-ad8c-999a3f18cfce] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:37.373821 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f85d82fa-0b5a-4f19-b7b8-13500d69aa9a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:37.384591 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f85d82fa-0b5a-4f19-b7b8-13500d69aa9a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.509359 Sep 26 05:30:37.388186 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 105/191] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:36 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:37.398534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a358c357-0323-442d-acdb-9b6357f653fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:37.409185 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a358c357-0323-442d-acdb-9b6357f653fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:37.409845 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a358c357-0323-442d-acdb-9b6357f653fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:37.410879 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a358c357-0323-442d-acdb-9b6357f653fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:37.412765 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a358c357-0323-442d-acdb-9b6357f653fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:37.413409 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a358c357-0323-442d-acdb-9b6357f653fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:37.452725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-a358c357-0323-442d-acdb-9b6357f653fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] HTTP exception thrown: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a358c357-0323-442d-acdb-9b6357f653fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Request method failure captured: Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce HTTP/1.1 Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTitbHeYeGmFJFAfaqtKnc22MYo3lp4Jnb6Pu0b8Cixgjt6p1gb7-PB700pknEYbzYE-3uhx9AveStPQ3Vb-WEIUHXKTUGhVd3koaACKYSY_0f7Exc1ihyahdeAhHqwHoT9-SsEbXpDtmj45KllZugJBpgR-8ByOSj348JpDHE4od1I Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: 0a676eb5cbd74956ba12b1d5595e3f18 Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-DeleteServersTestJSON-234650801 Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:30:37.454725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:30:37.455975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0a676eb5cbd74956ba12b1d5595e3f18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a676eb5cbd74956ba12b1d5595e3f18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a676eb5cbd74956ba12b1d5595e3f18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0a676eb5cbd74956ba12b1d5595e3f18"}]}] Sep 26 05:30:37.455975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-DeleteServersTestJSON-234650801 Sep 26 05:30:37.455975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 0a676eb5cbd74956ba12b1d5595e3f18 Sep 26 05:30:37.455975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-DeleteServersTestJSON-234650801 Sep 26 05:30:37.455975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-DeleteServersTestJSON-234650801-project Sep 26 05:30:37.455975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:30:37.455975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:30:37.455975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 4056ea3d1a1d48f2a34e14df77914363 Sep 26 05:30:37.455975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-DeleteServersTestJSON-234650801-project Sep 26 05:30:37.455975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:30:37.455975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:37.455975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': 'a31a978e-d8fb-4412-ad8c-999a3f18cfce'} Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:30:37.456672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:30:37.458284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:30:37.458284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:30:37.458284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:30:37.458284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:30:37.458284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:30:37.458284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:30:37.458284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:30:37.458284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:37.458284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:30:37.458284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:30:37.458284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:30:37.458284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:30:37.458284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:30:37.458284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:30:37.458284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:30:37.458284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:30:37.458284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. Sep 26 05:30:37.458284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:30:37.462802 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a358c357-0323-442d-acdb-9b6357f653fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] Returning 404 to user: Instance a31a978e-d8fb-4412-ad8c-999a3f18cfce could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:30:37.465970 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a358c357-0323-442d-acdb-9b6357f653fa tempest-DeleteServersTestJSON-234650801 tempest-DeleteServersTestJSON-234650801-project] 10.222.0.49 "GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce" status: 404 len: 111 microversion: 2.1 time: 0.106817 Sep 26 05:30:37.467128 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 87/192] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:37 2022] GET /compute/v2.1/servers/a31a978e-d8fb-4412-ad8c-999a3f18cfce => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:30:38.424085 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3dd75172-b4a3-45cf-be98-754985419849 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:38.425361 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-3dd75172-b4a3-45cf-be98-754985419849 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:38.445314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3dd75172-b4a3-45cf-be98-754985419849 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:38.445819 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3dd75172-b4a3-45cf-be98-754985419849 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:38.450169 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3dd75172-b4a3-45cf-be98-754985419849 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:38.454216 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3dd75172-b4a3-45cf-be98-754985419849 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:38.455750 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3dd75172-b4a3-45cf-be98-754985419849 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:38.456379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3dd75172-b4a3-45cf-be98-754985419849 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:39.084784 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-3dd75172-b4a3-45cf-be98-754985419849 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:39.114656 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-3dd75172-b4a3-45cf-be98-754985419849 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.695048 Sep 26 05:30:39.117702 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 106/193] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:38 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:40.144136 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ac7fbbb7-5427-43a1-92eb-86154a4c6c88 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:40.145974 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ac7fbbb7-5427-43a1-92eb-86154a4c6c88 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:40.166738 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ac7fbbb7-5427-43a1-92eb-86154a4c6c88 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:40.169582 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ac7fbbb7-5427-43a1-92eb-86154a4c6c88 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:40.172321 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ac7fbbb7-5427-43a1-92eb-86154a4c6c88 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:40.173500 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ac7fbbb7-5427-43a1-92eb-86154a4c6c88 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:40.175023 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ac7fbbb7-5427-43a1-92eb-86154a4c6c88 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:40.177076 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ac7fbbb7-5427-43a1-92eb-86154a4c6c88 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:40.834345 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ac7fbbb7-5427-43a1-92eb-86154a4c6c88 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:40.849680 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ac7fbbb7-5427-43a1-92eb-86154a4c6c88 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.710387 Sep 26 05:30:40.850291 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 88/194] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:40 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:41.879292 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5613d3f6-e347-4e11-9d22-240c2fea5d2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:41.880612 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5613d3f6-e347-4e11-9d22-240c2fea5d2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:41.894900 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=32 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:41.899954 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5613d3f6-e347-4e11-9d22-240c2fea5d2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:41.902352 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5613d3f6-e347-4e11-9d22-240c2fea5d2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:41.909360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5613d3f6-e347-4e11-9d22-240c2fea5d2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:41.921732 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5613d3f6-e347-4e11-9d22-240c2fea5d2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:41.922507 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5613d3f6-e347-4e11-9d22-240c2fea5d2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:41.923198 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5613d3f6-e347-4e11-9d22-240c2fea5d2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:42.294237 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5613d3f6-e347-4e11-9d22-240c2fea5d2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:42.306037 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-8ad9b29e-9c2b-432a-a4c4-980969e14286 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Action: 'create', calling method: .version_select at 0x7fd7b745c1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1112145332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvub28WORgOV2kvRL+M8zyzwsDL8wf/74GcPzcxF2HWdHgKDMKDcHXpHOFqT8UGGZ9z6Fk2SXWFjzhN1hvLuo7iKNBVVjSl9C/qSdLhaLsGzYHj3Lhk9H/94xqPE9GiEA=="}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:30:42.321036 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5613d3f6-e347-4e11-9d22-240c2fea5d2c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.450566 Sep 26 05:30:42.331076 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 89/195] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:41 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:30:42.360737 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-8ad9b29e-9c2b-432a-a4c4-980969e14286 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Getting quotas for project e1b5f9daf8d44a6987bbff8939ed7c92. Resources: {'key_pairs'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:30:42.371035 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-8ad9b29e-9c2b-432a-a4c4-980969e14286 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Getting quotas for user a0794e19f43a413db886750b0517d3d3 and project e1b5f9daf8d44a6987bbff8939ed7c92. Resources: {'key_pairs'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:30:42.445978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-8ad9b29e-9c2b-432a-a4c4-980969e14286 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.957329 Sep 26 05:30:42.452372 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 107/196] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 05:30:41 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:30:43.349110 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-df36e626-e7df-4f1d-a313-2fcd17808408 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:43.351719 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-df36e626-e7df-4f1d-a313-2fcd17808408 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:43.364034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-df36e626-e7df-4f1d-a313-2fcd17808408 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:43.365058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-df36e626-e7df-4f1d-a313-2fcd17808408 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:43.365783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-df36e626-e7df-4f1d-a313-2fcd17808408 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:43.376411 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-df36e626-e7df-4f1d-a313-2fcd17808408 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:43.380349 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-df36e626-e7df-4f1d-a313-2fcd17808408 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:43.382950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-df36e626-e7df-4f1d-a313-2fcd17808408 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:43.943279 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-df36e626-e7df-4f1d-a313-2fcd17808408 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:43.961115 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-df36e626-e7df-4f1d-a313-2fcd17808408 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.617496 Sep 26 05:30:43.978185 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 90/197] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:43 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:44.992371 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1d8ccd75-15c7-4ebb-87f7-10b41bfac271 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:44.993779 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-1d8ccd75-15c7-4ebb-87f7-10b41bfac271 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:45.013696 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1d8ccd75-15c7-4ebb-87f7-10b41bfac271 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:45.014638 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1d8ccd75-15c7-4ebb-87f7-10b41bfac271 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:45.021527 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1d8ccd75-15c7-4ebb-87f7-10b41bfac271 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:45.029953 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1d8ccd75-15c7-4ebb-87f7-10b41bfac271 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:45.029953 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1d8ccd75-15c7-4ebb-87f7-10b41bfac271 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:45.030389 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1d8ccd75-15c7-4ebb-87f7-10b41bfac271 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:45.879734 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1d8ccd75-15c7-4ebb-87f7-10b41bfac271 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:45.895743 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1d8ccd75-15c7-4ebb-87f7-10b41bfac271 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.909241 Sep 26 05:30:45.909343 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 108/198] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:44 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:46.924117 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c1b7bcf4-4ddd-4423-af38-6df8c8807f86 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:46.925308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c1b7bcf4-4ddd-4423-af38-6df8c8807f86 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:46.938272 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c1b7bcf4-4ddd-4423-af38-6df8c8807f86 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:46.939073 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c1b7bcf4-4ddd-4423-af38-6df8c8807f86 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:46.943431 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c1b7bcf4-4ddd-4423-af38-6df8c8807f86 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:46.944580 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c1b7bcf4-4ddd-4423-af38-6df8c8807f86 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:46.945201 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c1b7bcf4-4ddd-4423-af38-6df8c8807f86 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:46.945782 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c1b7bcf4-4ddd-4423-af38-6df8c8807f86 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:47.487133 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c1b7bcf4-4ddd-4423-af38-6df8c8807f86 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:47.529345 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c1b7bcf4-4ddd-4423-af38-6df8c8807f86 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.608640 Sep 26 05:30:47.539101 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 91/199] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:46 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:48.579349 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-0650383e-d3d5-42ad-aee1-affb08899cc3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:48.581120 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-0650383e-d3d5-42ad-aee1-affb08899cc3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:48.602406 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0650383e-d3d5-42ad-aee1-affb08899cc3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:48.603115 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0650383e-d3d5-42ad-aee1-affb08899cc3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:48.603560 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0650383e-d3d5-42ad-aee1-affb08899cc3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:48.604742 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0650383e-d3d5-42ad-aee1-affb08899cc3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:48.605215 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0650383e-d3d5-42ad-aee1-affb08899cc3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:48.607366 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0650383e-d3d5-42ad-aee1-affb08899cc3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:48.968831 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0650383e-d3d5-42ad-aee1-affb08899cc3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:48.981761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-0650383e-d3d5-42ad-aee1-affb08899cc3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.409031 Sep 26 05:30:48.982942 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 109/200] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:48 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:50.007076 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a7f35ead-5526-4ceb-83d3-b424a54fc8c1 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:50.007934 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a7f35ead-5526-4ceb-83d3-b424a54fc8c1 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:50.018337 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7f35ead-5526-4ceb-83d3-b424a54fc8c1 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:50.018826 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7f35ead-5526-4ceb-83d3-b424a54fc8c1 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:50.019528 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7f35ead-5526-4ceb-83d3-b424a54fc8c1 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:50.020591 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7f35ead-5526-4ceb-83d3-b424a54fc8c1 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:50.021390 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7f35ead-5526-4ceb-83d3-b424a54fc8c1 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:50.022073 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7f35ead-5526-4ceb-83d3-b424a54fc8c1 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:50.273323 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a7f35ead-5526-4ceb-83d3-b424a54fc8c1 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:50.282517 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a7f35ead-5526-4ceb-83d3-b424a54fc8c1 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.280170 Sep 26 05:30:50.283334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 92/201] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:50 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:50.989310 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-08ba3014-bcca-41d3-8f77-1ea3485c1a14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1293920", "imageRef": "d37a4f3d-6311-48af-9e33-4c62c14cdd1a", "flavorRef": "452", "networks": [{"uuid": "64bcaa83-8e16-496d-9ee2-d2efca0f0f90"}]}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:30:51.000019 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:51.054605 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.network.neutron [None req-08ba3014-bcca-41d3-8f77-1ea3485c1a14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] validate_networks() for [('64bcaa83-8e16-496d-9ee2-d2efca0f0f90', None, None, None, None, None)] {{(pid=120806) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:30:51.307191 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-011d33b9-9ab5-4491-8ae6-1c2ed125279c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:51.309189 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-011d33b9-9ab5-4491-8ae6-1c2ed125279c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:51.315889 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-011d33b9-9ab5-4491-8ae6-1c2ed125279c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:51.317442 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-011d33b9-9ab5-4491-8ae6-1c2ed125279c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:51.318258 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-011d33b9-9ab5-4491-8ae6-1c2ed125279c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:51.319179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-011d33b9-9ab5-4491-8ae6-1c2ed125279c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:51.320022 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-011d33b9-9ab5-4491-8ae6-1c2ed125279c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:51.320877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-011d33b9-9ab5-4491-8ae6-1c2ed125279c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:51.633637 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-011d33b9-9ab5-4491-8ae6-1c2ed125279c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:51.643259 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-011d33b9-9ab5-4491-8ae6-1c2ed125279c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1521 microversion: 2.1 time: 0.339856 Sep 26 05:30:51.646797 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 93/202] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:51 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:51.689624 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-08ba3014-bcca-41d3-8f77-1ea3485c1a14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Flavor limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:30:51.690437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-08ba3014-bcca-41d3-8f77-1ea3485c1a14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Image limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:30:51.691124 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-08ba3014-bcca-41d3-8f77-1ea3485c1a14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Flavor pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:30:51.692562 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-08ba3014-bcca-41d3-8f77-1ea3485c1a14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Image pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:30:51.693163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-08ba3014-bcca-41d3-8f77-1ea3485c1a14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:30:51.705940 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-08ba3014-bcca-41d3-8f77-1ea3485c1a14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:51.717383 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-08ba3014-bcca-41d3-8f77-1ea3485c1a14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:51.719774 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-08ba3014-bcca-41d3-8f77-1ea3485c1a14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:51.721407 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-08ba3014-bcca-41d3-8f77-1ea3485c1a14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:51.724178 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-08ba3014-bcca-41d3-8f77-1ea3485c1a14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:51.725549 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-08ba3014-bcca-41d3-8f77-1ea3485c1a14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:51.750101 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-08ba3014-bcca-41d3-8f77-1ea3485c1a14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Getting quotas for project 241e5470186a4c93b2465ecc84d80603. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:30:51.755402 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-08ba3014-bcca-41d3-8f77-1ea3485c1a14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Getting quotas for user 1e391d2591734de3bbe2515c703c4602 and project 241e5470186a4c93b2465ecc84d80603. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:30:51.782943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-08ba3014-bcca-41d3-8f77-1ea3485c1a14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Going to run 1 instances... {{(pid=120806) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:30:51.785979 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-08ba3014-bcca-41d3-8f77-1ea3485c1a14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d37a4f3d-6311-48af-9e33-4c62c14cdd1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120806) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:30:51.867743 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-08ba3014-bcca-41d3-8f77-1ea3485c1a14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.883359 Sep 26 05:30:51.870054 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 110/203] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:30:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:30:51.881481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6526555a-e8d0-4f51-863e-24cfa447582c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:51.882837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6526555a-e8d0-4f51-863e-24cfa447582c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:51.957898 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6526555a-e8d0-4f51-863e-24cfa447582c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:51.967270 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6526555a-e8d0-4f51-863e-24cfa447582c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1216 microversion: 2.1 time: 0.090747 Sep 26 05:30:51.968806 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 94/204] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:51 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1216 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:30:52.678775 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-55490505-346b-4e83-9772-9bc4f16f98cb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:52.679973 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-55490505-346b-4e83-9772-9bc4f16f98cb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:52.694550 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-55490505-346b-4e83-9772-9bc4f16f98cb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:52.698689 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-55490505-346b-4e83-9772-9bc4f16f98cb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:52.699702 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-55490505-346b-4e83-9772-9bc4f16f98cb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:52.701019 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-55490505-346b-4e83-9772-9bc4f16f98cb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:52.702070 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-55490505-346b-4e83-9772-9bc4f16f98cb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:52.703060 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-55490505-346b-4e83-9772-9bc4f16f98cb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:52.994523 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-86b3bb04-4ccc-4ce1-a6d4-1ec248dfb18a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:52.995885 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-86b3bb04-4ccc-4ce1-a6d4-1ec248dfb18a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:53.004478 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86b3bb04-4ccc-4ce1-a6d4-1ec248dfb18a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:53.005224 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86b3bb04-4ccc-4ce1-a6d4-1ec248dfb18a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:53.005860 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86b3bb04-4ccc-4ce1-a6d4-1ec248dfb18a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:53.006770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86b3bb04-4ccc-4ce1-a6d4-1ec248dfb18a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:53.007435 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86b3bb04-4ccc-4ce1-a6d4-1ec248dfb18a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:53.008054 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86b3bb04-4ccc-4ce1-a6d4-1ec248dfb18a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:53.023874 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-55490505-346b-4e83-9772-9bc4f16f98cb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:53.026080 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=95 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:53.034260 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-55490505-346b-4e83-9772-9bc4f16f98cb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1501 microversion: 2.1 time: 0.363070 Sep 26 05:30:53.034859 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 111/205] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:52 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1501 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:53.065017 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-4ecd9209-c5b5-472f-9d06-ca6424813bb0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:53.065634 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-4ecd9209-c5b5-472f-9d06-ca6424813bb0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:53.080036 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4ecd9209-c5b5-472f-9d06-ca6424813bb0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:53.080715 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4ecd9209-c5b5-472f-9d06-ca6424813bb0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:53.081329 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4ecd9209-c5b5-472f-9d06-ca6424813bb0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:53.082963 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4ecd9209-c5b5-472f-9d06-ca6424813bb0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:53.083666 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4ecd9209-c5b5-472f-9d06-ca6424813bb0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:53.084399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4ecd9209-c5b5-472f-9d06-ca6424813bb0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:53.148939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-86b3bb04-4ccc-4ce1-a6d4-1ec248dfb18a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:53.157480 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-86b3bb04-4ccc-4ce1-a6d4-1ec248dfb18a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1212 microversion: 2.1 time: 0.166634 Sep 26 05:30:53.178034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 95/206] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:52 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1212 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:53.287104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-4ecd9209-c5b5-472f-9d06-ca6424813bb0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:53.309107 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-4ecd9209-c5b5-472f-9d06-ca6424813bb0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1515 microversion: 2.1 time: 0.248083 Sep 26 05:30:53.314799 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 112/207] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:53 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1515 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:54.190784 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f4843220-c880-4813-8b7e-7a7047f6c3b3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:54.192177 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f4843220-c880-4813-8b7e-7a7047f6c3b3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:54.203089 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f4843220-c880-4813-8b7e-7a7047f6c3b3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:54.203864 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f4843220-c880-4813-8b7e-7a7047f6c3b3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:54.204709 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f4843220-c880-4813-8b7e-7a7047f6c3b3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:54.214818 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f4843220-c880-4813-8b7e-7a7047f6c3b3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:54.216779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f4843220-c880-4813-8b7e-7a7047f6c3b3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:54.218439 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f4843220-c880-4813-8b7e-7a7047f6c3b3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:54.411611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f4843220-c880-4813-8b7e-7a7047f6c3b3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:54.422259 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f4843220-c880-4813-8b7e-7a7047f6c3b3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1286 microversion: 2.1 time: 0.236486 Sep 26 05:30:54.436547 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 96/208] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:54 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1286 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:55.092318 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7966a8b0-8c5f-4328-a068-f5926bce2213 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:30:55.099596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7966a8b0-8c5f-4328-a068-f5926bce2213 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:55.115060 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7966a8b0-8c5f-4328-a068-f5926bce2213 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:55.116693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7966a8b0-8c5f-4328-a068-f5926bce2213 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:55.117407 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7966a8b0-8c5f-4328-a068-f5926bce2213 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:55.119709 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7966a8b0-8c5f-4328-a068-f5926bce2213 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:55.121994 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7966a8b0-8c5f-4328-a068-f5926bce2213 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:55.124534 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7966a8b0-8c5f-4328-a068-f5926bce2213 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:55.186276 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-7966a8b0-8c5f-4328-a068-f5926bce2213 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lazy-loading 'flavor' on Instance uuid 01274a67-17fb-45e3-9f2a-6a718b15b902 {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:30:55.342690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:55.407970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7966a8b0-8c5f-4328-a068-f5926bce2213 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "POST /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902/action" status: 200 len: 32 microversion: 2.1 time: 0.322711 Sep 26 05:30:55.413022 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 113/209] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 05:30:55 2022] POST /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902/action => generated 32 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:30:55.433128 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-41b91fe0-cba4-497d-b8fe-740cbba43a84 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:55.435389 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-41b91fe0-cba4-497d-b8fe-740cbba43a84 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:55.450091 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-41b91fe0-cba4-497d-b8fe-740cbba43a84 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:55.451084 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-41b91fe0-cba4-497d-b8fe-740cbba43a84 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:55.451763 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-41b91fe0-cba4-497d-b8fe-740cbba43a84 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:55.452792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-41b91fe0-cba4-497d-b8fe-740cbba43a84 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:55.453510 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-41b91fe0-cba4-497d-b8fe-740cbba43a84 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:55.454478 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-41b91fe0-cba4-497d-b8fe-740cbba43a84 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:55.455761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-88e17ede-0d7c-44f3-8ceb-51642eb3124e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:55.456523 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-88e17ede-0d7c-44f3-8ceb-51642eb3124e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:55.477554 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-88e17ede-0d7c-44f3-8ceb-51642eb3124e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:55.479156 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-88e17ede-0d7c-44f3-8ceb-51642eb3124e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:55.481840 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-88e17ede-0d7c-44f3-8ceb-51642eb3124e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:55.484979 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-88e17ede-0d7c-44f3-8ceb-51642eb3124e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:55.485694 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-88e17ede-0d7c-44f3-8ceb-51642eb3124e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:55.490535 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-88e17ede-0d7c-44f3-8ceb-51642eb3124e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:55.901743 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-88e17ede-0d7c-44f3-8ceb-51642eb3124e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:55.909636 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-88e17ede-0d7c-44f3-8ceb-51642eb3124e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1316 microversion: 2.1 time: 0.464691 Sep 26 05:30:55.912995 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 114/210] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:55 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1316 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:30:56.012145 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-41b91fe0-cba4-497d-b8fe-740cbba43a84 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:56.025881 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-41b91fe0-cba4-497d-b8fe-740cbba43a84 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.609723 Sep 26 05:30:56.026752 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 97/211] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:55 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:56.846058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-ff28a668-1476-4d7f-8262-c52b669b1e04 req-1dcbb9d8-7b12-4eeb-9b2a-f655b96532cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7efac409-bfde-4b69-a933-f76bf0442c1b", "tag": "48afb2fc-5507-40ee-ac44-fdd6ed4af3d2"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:30:56.876462 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-ff28a668-1476-4d7f-8262-c52b669b1e04 req-1dcbb9d8-7b12-4eeb-9b2a-f655b96532cc service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:56.877297 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-ff28a668-1476-4d7f-8262-c52b669b1e04 req-1dcbb9d8-7b12-4eeb-9b2a-f655b96532cc service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:56.880109 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-ff28a668-1476-4d7f-8262-c52b669b1e04 req-1dcbb9d8-7b12-4eeb-9b2a-f655b96532cc service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:56.921952 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-ff28a668-1476-4d7f-8262-c52b669b1e04 req-1dcbb9d8-7b12-4eeb-9b2a-f655b96532cc service nova] Creating event network-changed:48afb2fc-5507-40ee-ac44-fdd6ed4af3d2 for instance 7efac409-bfde-4b69-a933-f76bf0442c1b on hv-cinder-85918 Sep 26 05:30:56.932973 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-ff28a668-1476-4d7f-8262-c52b669b1e04 req-1dcbb9d8-7b12-4eeb-9b2a-f655b96532cc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094362 Sep 26 05:30:56.935835 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 115/212] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:30:56.948759 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2a9bbcaa-38f1-4999-89e9-6401dfa2c95e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:56.949487 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2a9bbcaa-38f1-4999-89e9-6401dfa2c95e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:56.964626 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a9bbcaa-38f1-4999-89e9-6401dfa2c95e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:56.965812 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a9bbcaa-38f1-4999-89e9-6401dfa2c95e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:56.966501 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a9bbcaa-38f1-4999-89e9-6401dfa2c95e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:56.967419 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a9bbcaa-38f1-4999-89e9-6401dfa2c95e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:56.968293 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a9bbcaa-38f1-4999-89e9-6401dfa2c95e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:56.968915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a9bbcaa-38f1-4999-89e9-6401dfa2c95e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:57.053866 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-57ca0b9f-8ce8-411b-a53a-5d475170c176 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:57.054545 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-57ca0b9f-8ce8-411b-a53a-5d475170c176 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:57.061602 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-57ca0b9f-8ce8-411b-a53a-5d475170c176 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:57.062408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-57ca0b9f-8ce8-411b-a53a-5d475170c176 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:57.063201 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-57ca0b9f-8ce8-411b-a53a-5d475170c176 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:57.063906 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-57ca0b9f-8ce8-411b-a53a-5d475170c176 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:57.064388 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-57ca0b9f-8ce8-411b-a53a-5d475170c176 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:57.066364 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-57ca0b9f-8ce8-411b-a53a-5d475170c176 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:57.288131 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2a9bbcaa-38f1-4999-89e9-6401dfa2c95e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:57.305270 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2a9bbcaa-38f1-4999-89e9-6401dfa2c95e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1316 microversion: 2.1 time: 0.364238 Sep 26 05:30:57.311595 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 98/213] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:56 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:57.432138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-57ca0b9f-8ce8-411b-a53a-5d475170c176 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:57.441733 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-57ca0b9f-8ce8-411b-a53a-5d475170c176 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.394906 Sep 26 05:30:57.443856 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 116/214] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:57 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:57.732924 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-644e525f-16b0-4e7f-9355-e972b68fca5d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Action: 'create', calling method: .version_select at 0x7fd7b74a1c10>, body: {"keypair": {"name": "tempest-keypair-1769127885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWNZ32Z6Ss1rk+0tpl4wiAOpdGektTwqnYKfLiYG99HUS+3+XuHCM8P9OHuh5WDiLhpC5bw9Zim0rENC8Db02NUJzkg8PfNObe31jCAjnNHGzngMdCbafPWjmO0fdJsgw=="}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:30:57.751983 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-644e525f-16b0-4e7f-9355-e972b68fca5d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Getting quotas for project 49fe69e57e744eea93988aecfa9decc2. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:30:57.757123 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-644e525f-16b0-4e7f-9355-e972b68fca5d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Getting quotas for user 30ccb163613a40ac8042f229199717f6 and project 49fe69e57e744eea93988aecfa9decc2. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:30:57.803444 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-644e525f-16b0-4e7f-9355-e972b68fca5d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.259318 Sep 26 05:30:57.806011 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 99/215] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 05:30:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:30:58.344735 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7cd930e3-9343-47c1-abbe-e8c13e97056f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:58.346454 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7cd930e3-9343-47c1-abbe-e8c13e97056f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:58.356488 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7cd930e3-9343-47c1-abbe-e8c13e97056f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:58.356982 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7cd930e3-9343-47c1-abbe-e8c13e97056f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:58.357433 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7cd930e3-9343-47c1-abbe-e8c13e97056f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:58.359350 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7cd930e3-9343-47c1-abbe-e8c13e97056f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:58.359882 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7cd930e3-9343-47c1-abbe-e8c13e97056f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:58.360350 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7cd930e3-9343-47c1-abbe-e8c13e97056f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:58.468061 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fcc81a25-6274-4f96-af0f-8893b48cfa6e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:58.469073 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fcc81a25-6274-4f96-af0f-8893b48cfa6e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:58.480239 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fcc81a25-6274-4f96-af0f-8893b48cfa6e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:58.481051 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fcc81a25-6274-4f96-af0f-8893b48cfa6e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:58.490209 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fcc81a25-6274-4f96-af0f-8893b48cfa6e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:58.491201 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fcc81a25-6274-4f96-af0f-8893b48cfa6e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:58.492374 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fcc81a25-6274-4f96-af0f-8893b48cfa6e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:58.493131 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fcc81a25-6274-4f96-af0f-8893b48cfa6e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:58.621040 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7cd930e3-9343-47c1-abbe-e8c13e97056f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:58.629416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7cd930e3-9343-47c1-abbe-e8c13e97056f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1316 microversion: 2.1 time: 0.292164 Sep 26 05:30:58.629990 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 117/216] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:58 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:58.727158 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fcc81a25-6274-4f96-af0f-8893b48cfa6e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:58.737287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fcc81a25-6274-4f96-af0f-8893b48cfa6e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.273886 Sep 26 05:30:58.758349 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 100/217] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:58 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:30:59.654625 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-2fedda3c-5953-4090-9bcd-04912ccf26ab tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:59.655252 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-2fedda3c-5953-4090-9bcd-04912ccf26ab tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:59.665733 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2fedda3c-5953-4090-9bcd-04912ccf26ab tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:59.666241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2fedda3c-5953-4090-9bcd-04912ccf26ab tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:59.666733 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2fedda3c-5953-4090-9bcd-04912ccf26ab tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:59.667653 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2fedda3c-5953-4090-9bcd-04912ccf26ab tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:59.668116 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2fedda3c-5953-4090-9bcd-04912ccf26ab tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:59.668594 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2fedda3c-5953-4090-9bcd-04912ccf26ab tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:59.765431 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c590e92b-c31a-43e6-883d-837714c46874 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:30:59.766443 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c590e92b-c31a-43e6-883d-837714c46874 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:30:59.778606 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c590e92b-c31a-43e6-883d-837714c46874 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:59.779188 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c590e92b-c31a-43e6-883d-837714c46874 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:59.779863 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c590e92b-c31a-43e6-883d-837714c46874 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:59.780795 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c590e92b-c31a-43e6-883d-837714c46874 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:30:59.781462 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c590e92b-c31a-43e6-883d-837714c46874 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:30:59.782079 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c590e92b-c31a-43e6-883d-837714c46874 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:30:59.814129 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2fedda3c-5953-4090-9bcd-04912ccf26ab tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:30:59.825101 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2fedda3c-5953-4090-9bcd-04912ccf26ab tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1316 microversion: 2.1 time: 0.175226 Sep 26 05:30:59.825730 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 118/218] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:59 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:00.006705 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c590e92b-c31a-43e6-883d-837714c46874 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:00.015098 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c590e92b-c31a-43e6-883d-837714c46874 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.253763 Sep 26 05:31:00.016058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 101/219] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:30:59 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:00.105184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-fd21e74f-5fe3-4083-ad51-300c2608d1ed tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1740809764", "imageRef": "d37a4f3d-6311-48af-9e33-4c62c14cdd1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6a60f69-a1be-43ae-8a50-02a99ceaebaf"}], "security_groups": [{"name": "tempest-securitygroup--1458059658"}], "key_name": "tempest-keypair-1769127885", "user_data": "}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:00.259018 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.network.neutron [None req-fd21e74f-5fe3-4083-ad51-300c2608d1ed tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] validate_networks() for [('d6a60f69-a1be-43ae-8a50-02a99ceaebaf', None, None, None, None, None)] {{(pid=120806) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:31:00.674683 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-fd21e74f-5fe3-4083-ad51-300c2608d1ed tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Flavor limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:31:00.675500 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-fd21e74f-5fe3-4083-ad51-300c2608d1ed tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Image limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:31:00.675818 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-fd21e74f-5fe3-4083-ad51-300c2608d1ed tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Flavor pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:31:00.676397 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-fd21e74f-5fe3-4083-ad51-300c2608d1ed tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Image pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:31:00.676801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-fd21e74f-5fe3-4083-ad51-300c2608d1ed tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:31:00.693372 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fd21e74f-5fe3-4083-ad51-300c2608d1ed tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:00.694012 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fd21e74f-5fe3-4083-ad51-300c2608d1ed tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:00.694936 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fd21e74f-5fe3-4083-ad51-300c2608d1ed tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:00.696457 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fd21e74f-5fe3-4083-ad51-300c2608d1ed tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:00.697538 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fd21e74f-5fe3-4083-ad51-300c2608d1ed tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:00.698307 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fd21e74f-5fe3-4083-ad51-300c2608d1ed tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:00.726162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-fd21e74f-5fe3-4083-ad51-300c2608d1ed tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Getting quotas for project 49fe69e57e744eea93988aecfa9decc2. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:31:00.730575 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-fd21e74f-5fe3-4083-ad51-300c2608d1ed tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Getting quotas for user 30ccb163613a40ac8042f229199717f6 and project 49fe69e57e744eea93988aecfa9decc2. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:31:00.749718 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-fd21e74f-5fe3-4083-ad51-300c2608d1ed tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Going to run 1 instances... {{(pid=120806) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:31:00.752124 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-fd21e74f-5fe3-4083-ad51-300c2608d1ed tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d37a4f3d-6311-48af-9e33-4c62c14cdd1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120806) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:31:00.826516 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-fd21e74f-5fe3-4083-ad51-300c2608d1ed tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.725869 Sep 26 05:31:00.840521 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-29652f29-b9db-4f63-bf4f-12185d3789f5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:00.841146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-29652f29-b9db-4f63-bf4f-12185d3789f5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:00.851617 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 119/220] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:31:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:31:00.859284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d73d3312-003f-4d3a-8de8-4f832e12ac68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:00.869378 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d73d3312-003f-4d3a-8de8-4f832e12ac68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:00.879872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d73d3312-003f-4d3a-8de8-4f832e12ac68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:00.880614 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d73d3312-003f-4d3a-8de8-4f832e12ac68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:00.881244 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d73d3312-003f-4d3a-8de8-4f832e12ac68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:00.882264 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d73d3312-003f-4d3a-8de8-4f832e12ac68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:00.882892 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d73d3312-003f-4d3a-8de8-4f832e12ac68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:00.883484 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d73d3312-003f-4d3a-8de8-4f832e12ac68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:00.944027 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-29652f29-b9db-4f63-bf4f-12185d3789f5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:00.952109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-29652f29-b9db-4f63-bf4f-12185d3789f5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1238 microversion: 2.1 time: 0.115705 Sep 26 05:31:00.955016 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 102/221] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:00 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1238 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:01.041246 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4447835b-788c-49b2-b16a-73a0cf3adb59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:01.042464 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4447835b-788c-49b2-b16a-73a0cf3adb59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:01.051847 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4447835b-788c-49b2-b16a-73a0cf3adb59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:01.052788 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4447835b-788c-49b2-b16a-73a0cf3adb59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:01.053406 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4447835b-788c-49b2-b16a-73a0cf3adb59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:01.054598 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4447835b-788c-49b2-b16a-73a0cf3adb59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:01.055404 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4447835b-788c-49b2-b16a-73a0cf3adb59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:01.062936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4447835b-788c-49b2-b16a-73a0cf3adb59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:01.212035 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d73d3312-003f-4d3a-8de8-4f832e12ac68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:01.220655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d73d3312-003f-4d3a-8de8-4f832e12ac68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1316 microversion: 2.1 time: 0.367695 Sep 26 05:31:01.228507 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 120/222] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:00 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1316 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:01.371010 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4447835b-788c-49b2-b16a-73a0cf3adb59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:01.404448 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4447835b-788c-49b2-b16a-73a0cf3adb59 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.358822 Sep 26 05:31:01.424379 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 103/223] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:01 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:01.995159 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3a55c829-d966-49d9-9dcc-84248a276aad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:01.997530 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-3a55c829-d966-49d9-9dcc-84248a276aad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:02.015466 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3a55c829-d966-49d9-9dcc-84248a276aad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:02.017402 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3a55c829-d966-49d9-9dcc-84248a276aad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:02.019529 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3a55c829-d966-49d9-9dcc-84248a276aad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:02.020991 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3a55c829-d966-49d9-9dcc-84248a276aad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:02.021605 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3a55c829-d966-49d9-9dcc-84248a276aad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:02.022823 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3a55c829-d966-49d9-9dcc-84248a276aad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:02.121133 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-3a55c829-d966-49d9-9dcc-84248a276aad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:02.129876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-3a55c829-d966-49d9-9dcc-84248a276aad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1242 microversion: 2.1 time: 0.143607 Sep 26 05:31:02.130780 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 121/224] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:01 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1242 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:02.249689 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-22907bfc-6fd2-42f9-90fd-07d7d0a9f1dd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:02.251121 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-22907bfc-6fd2-42f9-90fd-07d7d0a9f1dd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:02.259604 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22907bfc-6fd2-42f9-90fd-07d7d0a9f1dd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:02.260402 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22907bfc-6fd2-42f9-90fd-07d7d0a9f1dd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:02.260904 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22907bfc-6fd2-42f9-90fd-07d7d0a9f1dd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:02.261657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22907bfc-6fd2-42f9-90fd-07d7d0a9f1dd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:02.262112 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22907bfc-6fd2-42f9-90fd-07d7d0a9f1dd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:02.262866 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22907bfc-6fd2-42f9-90fd-07d7d0a9f1dd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:02.434034 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-ef57e0eb-65b0-4920-8a57-c2f20225942a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:02.434647 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-ef57e0eb-65b0-4920-8a57-c2f20225942a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:02.441973 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ef57e0eb-65b0-4920-8a57-c2f20225942a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:02.442543 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ef57e0eb-65b0-4920-8a57-c2f20225942a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:02.442973 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ef57e0eb-65b0-4920-8a57-c2f20225942a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:02.443896 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ef57e0eb-65b0-4920-8a57-c2f20225942a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:02.444574 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ef57e0eb-65b0-4920-8a57-c2f20225942a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:02.445149 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ef57e0eb-65b0-4920-8a57-c2f20225942a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:02.453239 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-22907bfc-6fd2-42f9-90fd-07d7d0a9f1dd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:02.473534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-22907bfc-6fd2-42f9-90fd-07d7d0a9f1dd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1316 microversion: 2.1 time: 0.227731 Sep 26 05:31:02.483742 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 104/225] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:02 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:02.589297 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-ef57e0eb-65b0-4920-8a57-c2f20225942a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:02.597939 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-ef57e0eb-65b0-4920-8a57-c2f20225942a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.166921 Sep 26 05:31:02.598551 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 122/226] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:02 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:03.154252 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-83bf4362-509e-478d-8a73-13a08feccf7b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:03.154894 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-83bf4362-509e-478d-8a73-13a08feccf7b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:03.162499 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83bf4362-509e-478d-8a73-13a08feccf7b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:03.163060 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83bf4362-509e-478d-8a73-13a08feccf7b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:03.163512 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83bf4362-509e-478d-8a73-13a08feccf7b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:03.164267 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83bf4362-509e-478d-8a73-13a08feccf7b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:03.164725 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83bf4362-509e-478d-8a73-13a08feccf7b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:03.165147 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83bf4362-509e-478d-8a73-13a08feccf7b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:03.229198 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-83bf4362-509e-478d-8a73-13a08feccf7b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:03.237281 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-83bf4362-509e-478d-8a73-13a08feccf7b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1242 microversion: 2.1 time: 0.086877 Sep 26 05:31:03.237961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 105/227] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:03 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:03.497136 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-726a59d1-d9b1-41de-8013-df4b8ce679bb tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:03.497751 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-726a59d1-d9b1-41de-8013-df4b8ce679bb tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:03.504789 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-726a59d1-d9b1-41de-8013-df4b8ce679bb tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:03.505281 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-726a59d1-d9b1-41de-8013-df4b8ce679bb tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:03.505718 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-726a59d1-d9b1-41de-8013-df4b8ce679bb tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:03.506407 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-726a59d1-d9b1-41de-8013-df4b8ce679bb tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:03.506868 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-726a59d1-d9b1-41de-8013-df4b8ce679bb tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:03.507298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-726a59d1-d9b1-41de-8013-df4b8ce679bb tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:03.621714 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-093ada07-0cdf-4d68-9068-fbea6451c4ea tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:03.622320 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-093ada07-0cdf-4d68-9068-fbea6451c4ea tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:03.629514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-093ada07-0cdf-4d68-9068-fbea6451c4ea tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:03.629994 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-093ada07-0cdf-4d68-9068-fbea6451c4ea tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:03.630422 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-093ada07-0cdf-4d68-9068-fbea6451c4ea tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:03.631110 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-093ada07-0cdf-4d68-9068-fbea6451c4ea tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:03.631562 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-093ada07-0cdf-4d68-9068-fbea6451c4ea tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:03.631982 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-093ada07-0cdf-4d68-9068-fbea6451c4ea tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:03.634243 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-726a59d1-d9b1-41de-8013-df4b8ce679bb tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:03.641805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-726a59d1-d9b1-41de-8013-df4b8ce679bb tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1316 microversion: 2.1 time: 0.148558 Sep 26 05:31:03.642374 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 123/228] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:03 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:03.768601 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-093ada07-0cdf-4d68-9068-fbea6451c4ea tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:03.775202 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-093ada07-0cdf-4d68-9068-fbea6451c4ea tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.157169 Sep 26 05:31:03.775768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 106/229] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:03 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:04.085580 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a926b135-86b7-467b-945a-704d3b60d0f3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:04.086081 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a926b135-86b7-467b-945a-704d3b60d0f3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:04.092121 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a926b135-86b7-467b-945a-704d3b60d0f3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:04.092643 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a926b135-86b7-467b-945a-704d3b60d0f3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:04.093085 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a926b135-86b7-467b-945a-704d3b60d0f3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:04.093777 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a926b135-86b7-467b-945a-704d3b60d0f3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:04.094231 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a926b135-86b7-467b-945a-704d3b60d0f3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:04.094659 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a926b135-86b7-467b-945a-704d3b60d0f3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:04.119783 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a926b135-86b7-467b-945a-704d3b60d0f3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/ips" status: 200 len: 151 microversion: 2.20 time: 0.038542 Sep 26 05:31:04.125168 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 124/230] 10.222.0.49 () {60 vars in 1289 bytes} [Mon Sep 26 05:31:04 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:31:04.262289 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-87d7db73-f03c-48bb-aa68-ad276f8b0d25 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:04.263302 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-87d7db73-f03c-48bb-aa68-ad276f8b0d25 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:04.269973 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87d7db73-f03c-48bb-aa68-ad276f8b0d25 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:04.270894 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87d7db73-f03c-48bb-aa68-ad276f8b0d25 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:04.271498 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87d7db73-f03c-48bb-aa68-ad276f8b0d25 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:04.272418 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87d7db73-f03c-48bb-aa68-ad276f8b0d25 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:04.272901 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87d7db73-f03c-48bb-aa68-ad276f8b0d25 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:04.273402 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87d7db73-f03c-48bb-aa68-ad276f8b0d25 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:04.341032 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-87d7db73-f03c-48bb-aa68-ad276f8b0d25 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:04.351157 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-87d7db73-f03c-48bb-aa68-ad276f8b0d25 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1242 microversion: 2.1 time: 0.094538 Sep 26 05:31:04.353499 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 107/231] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:04 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:04.666671 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c8f8d526-dc89-4236-ba84-d952f9b4df9e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:04.667256 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c8f8d526-dc89-4236-ba84-d952f9b4df9e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:04.673246 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c8f8d526-dc89-4236-ba84-d952f9b4df9e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:04.673724 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c8f8d526-dc89-4236-ba84-d952f9b4df9e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:04.674160 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c8f8d526-dc89-4236-ba84-d952f9b4df9e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:04.674923 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c8f8d526-dc89-4236-ba84-d952f9b4df9e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:04.675926 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c8f8d526-dc89-4236-ba84-d952f9b4df9e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:04.676376 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c8f8d526-dc89-4236-ba84-d952f9b4df9e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:04.798417 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cab73369-bd93-468f-85e2-68557911de14 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:04.799040 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cab73369-bd93-468f-85e2-68557911de14 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:04.803852 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-c8f8d526-dc89-4236-ba84-d952f9b4df9e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:04.805871 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cab73369-bd93-468f-85e2-68557911de14 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:04.806284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cab73369-bd93-468f-85e2-68557911de14 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:04.806731 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cab73369-bd93-468f-85e2-68557911de14 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:04.807444 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cab73369-bd93-468f-85e2-68557911de14 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:04.807923 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cab73369-bd93-468f-85e2-68557911de14 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:04.808401 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cab73369-bd93-468f-85e2-68557911de14 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:04.812264 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c8f8d526-dc89-4236-ba84-d952f9b4df9e tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1316 microversion: 2.1 time: 0.149574 Sep 26 05:31:04.812956 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 125/232] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:04 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:04.936997 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cab73369-bd93-468f-85e2-68557911de14 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:04.944657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cab73369-bd93-468f-85e2-68557911de14 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.150136 Sep 26 05:31:04.945218 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 108/233] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:04 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:05.376146 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9e0c1acd-aa0d-4e41-b1aa-e2b007807908 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:05.376840 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-9e0c1acd-aa0d-4e41-b1aa-e2b007807908 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:05.384770 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9e0c1acd-aa0d-4e41-b1aa-e2b007807908 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:05.385565 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9e0c1acd-aa0d-4e41-b1aa-e2b007807908 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:05.386148 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9e0c1acd-aa0d-4e41-b1aa-e2b007807908 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:05.386905 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9e0c1acd-aa0d-4e41-b1aa-e2b007807908 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:05.387389 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9e0c1acd-aa0d-4e41-b1aa-e2b007807908 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:05.387811 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9e0c1acd-aa0d-4e41-b1aa-e2b007807908 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:05.456221 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-9e0c1acd-aa0d-4e41-b1aa-e2b007807908 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:05.464593 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-9e0c1acd-aa0d-4e41-b1aa-e2b007807908 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1290 microversion: 2.1 time: 0.092395 Sep 26 05:31:05.465159 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 126/234] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:05 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:05.587460 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-582aa4db-c181-4f47-9810-f9ab03348341 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:05.588225 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-582aa4db-c181-4f47-9810-f9ab03348341 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:05.594634 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-582aa4db-c181-4f47-9810-f9ab03348341 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:05.595113 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-582aa4db-c181-4f47-9810-f9ab03348341 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:05.595543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-582aa4db-c181-4f47-9810-f9ab03348341 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:05.596222 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-582aa4db-c181-4f47-9810-f9ab03348341 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:05.596693 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-582aa4db-c181-4f47-9810-f9ab03348341 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:05.597107 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-582aa4db-c181-4f47-9810-f9ab03348341 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:05.621295 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-582aa4db-c181-4f47-9810-f9ab03348341 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/ips" status: 200 len: 148 microversion: 2.1 time: 0.037696 Sep 26 05:31:05.621866 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 109/235] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 05:31:05 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:31:05.836977 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-014179dd-8c6b-48bf-8fcd-1a43043b446a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:05.838887 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-014179dd-8c6b-48bf-8fcd-1a43043b446a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:05.847907 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-014179dd-8c6b-48bf-8fcd-1a43043b446a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:05.849023 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-014179dd-8c6b-48bf-8fcd-1a43043b446a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:05.849662 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-014179dd-8c6b-48bf-8fcd-1a43043b446a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:05.864530 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-014179dd-8c6b-48bf-8fcd-1a43043b446a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:05.865293 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-014179dd-8c6b-48bf-8fcd-1a43043b446a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:05.865750 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-014179dd-8c6b-48bf-8fcd-1a43043b446a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:05.966820 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cb9b39b4-ef8d-4474-8499-9d5e33c46e3d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:05.967438 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cb9b39b4-ef8d-4474-8499-9d5e33c46e3d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:05.973752 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb9b39b4-ef8d-4474-8499-9d5e33c46e3d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:05.974497 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb9b39b4-ef8d-4474-8499-9d5e33c46e3d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:05.975264 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb9b39b4-ef8d-4474-8499-9d5e33c46e3d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:05.976022 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb9b39b4-ef8d-4474-8499-9d5e33c46e3d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:05.976695 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb9b39b4-ef8d-4474-8499-9d5e33c46e3d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:05.977315 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb9b39b4-ef8d-4474-8499-9d5e33c46e3d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:06.037611 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-014179dd-8c6b-48bf-8fcd-1a43043b446a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:06.045988 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-014179dd-8c6b-48bf-8fcd-1a43043b446a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1316 microversion: 2.1 time: 0.214072 Sep 26 05:31:06.046576 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 127/236] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:05 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:06.130567 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cb9b39b4-ef8d-4474-8499-9d5e33c46e3d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:06.139228 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cb9b39b4-ef8d-4474-8499-9d5e33c46e3d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.176115 Sep 26 05:31:06.140035 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 110/237] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:05 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:06.489765 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9511d292-aaa3-4db1-9162-77c45fa3ac57 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:06.490589 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-9511d292-aaa3-4db1-9162-77c45fa3ac57 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:06.496801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9511d292-aaa3-4db1-9162-77c45fa3ac57 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:06.499847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9511d292-aaa3-4db1-9162-77c45fa3ac57 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:06.500545 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9511d292-aaa3-4db1-9162-77c45fa3ac57 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:06.501425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9511d292-aaa3-4db1-9162-77c45fa3ac57 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:06.501901 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9511d292-aaa3-4db1-9162-77c45fa3ac57 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:06.502337 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9511d292-aaa3-4db1-9162-77c45fa3ac57 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:06.587208 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-9511d292-aaa3-4db1-9162-77c45fa3ac57 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:06.597554 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-9511d292-aaa3-4db1-9162-77c45fa3ac57 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1296 microversion: 2.1 time: 0.112927 Sep 26 05:31:06.598485 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 128/238] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:06 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1296 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:07.018358 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3e690b6c-f3ba-4ee8-bb4c-5dde842d9a95 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "212e60f4-0cc3-4e97-b6e6-7e5d6ca686c8"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:07.021875 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3e690b6c-f3ba-4ee8-bb4c-5dde842d9a95 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:07.033924 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e690b6c-f3ba-4ee8-bb4c-5dde842d9a95 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:07.034070 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e690b6c-f3ba-4ee8-bb4c-5dde842d9a95 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:07.034447 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e690b6c-f3ba-4ee8-bb4c-5dde842d9a95 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:07.035153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e690b6c-f3ba-4ee8-bb4c-5dde842d9a95 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:07.036244 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e690b6c-f3ba-4ee8-bb4c-5dde842d9a95 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:07.036757 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e690b6c-f3ba-4ee8-bb4c-5dde842d9a95 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:07.069829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-86dfe8e4-1754-45e4-8c8d-bf5a1de7f0c4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:07.070609 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-86dfe8e4-1754-45e4-8c8d-bf5a1de7f0c4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:07.088271 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-86dfe8e4-1754-45e4-8c8d-bf5a1de7f0c4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:07.089050 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-86dfe8e4-1754-45e4-8c8d-bf5a1de7f0c4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:07.089712 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-86dfe8e4-1754-45e4-8c8d-bf5a1de7f0c4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:07.090609 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-86dfe8e4-1754-45e4-8c8d-bf5a1de7f0c4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:07.091209 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-86dfe8e4-1754-45e4-8c8d-bf5a1de7f0c4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:07.092007 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-86dfe8e4-1754-45e4-8c8d-bf5a1de7f0c4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:07.262648 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-86dfe8e4-1754-45e4-8c8d-bf5a1de7f0c4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:07.270472 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-86dfe8e4-1754-45e4-8c8d-bf5a1de7f0c4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1316 microversion: 2.1 time: 0.205079 Sep 26 05:31:07.271044 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 129/239] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:07 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1316 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:07.282188 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-4c71fa0b-15b7-46bf-ad92-cd264a08f5cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:07.283033 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-4c71fa0b-15b7-46bf-ad92-cd264a08f5cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:07.291579 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4c71fa0b-15b7-46bf-ad92-cd264a08f5cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:07.292364 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4c71fa0b-15b7-46bf-ad92-cd264a08f5cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:07.293005 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4c71fa0b-15b7-46bf-ad92-cd264a08f5cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:07.293982 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4c71fa0b-15b7-46bf-ad92-cd264a08f5cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:07.294606 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4c71fa0b-15b7-46bf-ad92-cd264a08f5cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:07.295244 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4c71fa0b-15b7-46bf-ad92-cd264a08f5cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:07.458136 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3e690b6c-f3ba-4ee8-bb4c-5dde842d9a95 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "POST /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.442585 Sep 26 05:31:07.458878 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 111/240] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 05:31:07 2022] POST /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments => generated 194 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:31:07.469370 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-d29b72e2-54de-415c-9931-4976cbc78f19 req-858e7e10-e84a-40d5-a008-77addf0ae436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7efac409-bfde-4b69-a933-f76bf0442c1b", "name": "network-vif-plugged", "status": "completed", "tag": "48afb2fc-5507-40ee-ac44-fdd6ed4af3d2"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:07.476969 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-4c71fa0b-15b7-46bf-ad92-cd264a08f5cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:07.480633 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-d29b72e2-54de-415c-9931-4976cbc78f19 req-858e7e10-e84a-40d5-a008-77addf0ae436 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:07.481127 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-d29b72e2-54de-415c-9931-4976cbc78f19 req-858e7e10-e84a-40d5-a008-77addf0ae436 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:07.481556 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-d29b72e2-54de-415c-9931-4976cbc78f19 req-858e7e10-e84a-40d5-a008-77addf0ae436 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:07.486579 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-4c71fa0b-15b7-46bf-ad92-cd264a08f5cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.212338 Sep 26 05:31:07.487208 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 130/241] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:07 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:07.499897 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-d29b72e2-54de-415c-9931-4976cbc78f19 req-858e7e10-e84a-40d5-a008-77addf0ae436 service nova] Creating event network-vif-plugged:48afb2fc-5507-40ee-ac44-fdd6ed4af3d2 for instance 7efac409-bfde-4b69-a933-f76bf0442c1b on hv-cinder-85918 Sep 26 05:31:07.507633 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-d29b72e2-54de-415c-9931-4976cbc78f19 req-858e7e10-e84a-40d5-a008-77addf0ae436 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046679 Sep 26 05:31:07.508270 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 112/242] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:31:07.624933 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d858bd56-8f1b-4f51-b68f-34121189e091 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:07.625632 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d858bd56-8f1b-4f51-b68f-34121189e091 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:07.632605 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d858bd56-8f1b-4f51-b68f-34121189e091 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:07.633416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d858bd56-8f1b-4f51-b68f-34121189e091 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:07.634027 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d858bd56-8f1b-4f51-b68f-34121189e091 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:07.634989 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d858bd56-8f1b-4f51-b68f-34121189e091 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:07.635494 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d858bd56-8f1b-4f51-b68f-34121189e091 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:07.636143 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d858bd56-8f1b-4f51-b68f-34121189e091 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:07.809817 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-cf109c0f-9f01-4e36-a688-fabfb5f42aca req-970b171b-81f1-47ac-b70c-4c6f9f77e53c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de4a6090-4a17-4d48-806a-1fbfb8556e47", "tag": "6c8f3d3c-69f4-4522-90e1-444ce9de2135"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:07.827293 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-cf109c0f-9f01-4e36-a688-fabfb5f42aca req-970b171b-81f1-47ac-b70c-4c6f9f77e53c service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:07.828489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-cf109c0f-9f01-4e36-a688-fabfb5f42aca req-970b171b-81f1-47ac-b70c-4c6f9f77e53c service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:07.829173 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-cf109c0f-9f01-4e36-a688-fabfb5f42aca req-970b171b-81f1-47ac-b70c-4c6f9f77e53c service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:07.846638 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-cf109c0f-9f01-4e36-a688-fabfb5f42aca req-970b171b-81f1-47ac-b70c-4c6f9f77e53c service nova] Creating event network-changed:6c8f3d3c-69f4-4522-90e1-444ce9de2135 for instance de4a6090-4a17-4d48-806a-1fbfb8556e47 on hv-cinder-85918 Sep 26 05:31:07.855372 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-cf109c0f-9f01-4e36-a688-fabfb5f42aca req-970b171b-81f1-47ac-b70c-4c6f9f77e53c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049676 Sep 26 05:31:07.856471 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 113/243] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:31:08.141893 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d858bd56-8f1b-4f51-b68f-34121189e091 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:08.147603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:08.153368 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d858bd56-8f1b-4f51-b68f-34121189e091 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1364 microversion: 2.1 time: 0.532319 Sep 26 05:31:08.153986 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 131/244] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:07 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1364 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:08.299118 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ab94fe56-86ad-43e9-bac1-10ba74b91002 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:08.300549 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ab94fe56-86ad-43e9-bac1-10ba74b91002 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:08.307156 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab94fe56-86ad-43e9-bac1-10ba74b91002 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:08.307638 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab94fe56-86ad-43e9-bac1-10ba74b91002 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:08.308067 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab94fe56-86ad-43e9-bac1-10ba74b91002 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:08.309361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab94fe56-86ad-43e9-bac1-10ba74b91002 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:08.309988 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab94fe56-86ad-43e9-bac1-10ba74b91002 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:08.310416 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab94fe56-86ad-43e9-bac1-10ba74b91002 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:08.313197 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:08.448306 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ab94fe56-86ad-43e9-bac1-10ba74b91002 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:08.456365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ab94fe56-86ad-43e9-bac1-10ba74b91002 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1316 microversion: 2.1 time: 0.162607 Sep 26 05:31:08.456953 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 114/245] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:08 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:08.510989 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d26821e1-f094-40d3-951b-794a36999052 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:08.511598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d26821e1-f094-40d3-951b-794a36999052 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:08.518231 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d26821e1-f094-40d3-951b-794a36999052 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:08.518713 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d26821e1-f094-40d3-951b-794a36999052 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:08.519144 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d26821e1-f094-40d3-951b-794a36999052 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:08.520543 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d26821e1-f094-40d3-951b-794a36999052 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:08.521003 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d26821e1-f094-40d3-951b-794a36999052 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:08.521424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d26821e1-f094-40d3-951b-794a36999052 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:08.627109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-420704d0-af10-4d90-b38d-80b62215ad84 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:08.627636 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-420704d0-af10-4d90-b38d-80b62215ad84 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:08.634237 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-420704d0-af10-4d90-b38d-80b62215ad84 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:08.634716 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-420704d0-af10-4d90-b38d-80b62215ad84 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:08.635147 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-420704d0-af10-4d90-b38d-80b62215ad84 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:08.635827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-420704d0-af10-4d90-b38d-80b62215ad84 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:08.636289 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-420704d0-af10-4d90-b38d-80b62215ad84 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:08.636710 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-420704d0-af10-4d90-b38d-80b62215ad84 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:08.659835 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-420704d0-af10-4d90-b38d-80b62215ad84 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lazy-loading 'flavor' on Instance uuid 6ffa337e-39e1-4edc-9a0d-4468ff05c577 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:31:08.666714 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d26821e1-f094-40d3-951b-794a36999052 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:08.675236 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d26821e1-f094-40d3-951b-794a36999052 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.168826 Sep 26 05:31:08.675936 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 132/246] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:08 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:08.889140 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-420704d0-af10-4d90-b38d-80b62215ad84 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "POST /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/action" status: 202 len: 0 microversion: 2.20 time: 0.265727 Sep 26 05:31:08.889727 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 115/247] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Sep 26 05:31:08 2022] POST /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 26 05:31:08.898143 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-ab9228e8-b38e-4fdc-8caf-f9dd4bdc08c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:08.898720 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-ab9228e8-b38e-4fdc-8caf-f9dd4bdc08c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:08.904701 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ab9228e8-b38e-4fdc-8caf-f9dd4bdc08c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:08.905183 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ab9228e8-b38e-4fdc-8caf-f9dd4bdc08c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:08.905626 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ab9228e8-b38e-4fdc-8caf-f9dd4bdc08c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:08.906310 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ab9228e8-b38e-4fdc-8caf-f9dd4bdc08c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:08.906765 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ab9228e8-b38e-4fdc-8caf-f9dd4bdc08c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:08.907189 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ab9228e8-b38e-4fdc-8caf-f9dd4bdc08c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:09.036674 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-ab9228e8-b38e-4fdc-8caf-f9dd4bdc08c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:09.044761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-ab9228e8-b38e-4fdc-8caf-f9dd4bdc08c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:09.046226 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-ab9228e8-b38e-4fdc-8caf-f9dd4bdc08c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:09.047393 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-ab9228e8-b38e-4fdc-8caf-f9dd4bdc08c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.153352 Sep 26 05:31:09.047952 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 133/248] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:08 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:31:09.177838 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b53bdae5-dbc2-4ddc-b072-e41748ed9f32 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:09.178625 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b53bdae5-dbc2-4ddc-b072-e41748ed9f32 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:09.185591 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b53bdae5-dbc2-4ddc-b072-e41748ed9f32 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:09.186084 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b53bdae5-dbc2-4ddc-b072-e41748ed9f32 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:09.186520 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b53bdae5-dbc2-4ddc-b072-e41748ed9f32 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:09.187210 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b53bdae5-dbc2-4ddc-b072-e41748ed9f32 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:09.187744 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b53bdae5-dbc2-4ddc-b072-e41748ed9f32 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:09.188171 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b53bdae5-dbc2-4ddc-b072-e41748ed9f32 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:09.322907 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b53bdae5-dbc2-4ddc-b072-e41748ed9f32 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:09.330855 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b53bdae5-dbc2-4ddc-b072-e41748ed9f32 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1364 microversion: 2.1 time: 0.157768 Sep 26 05:31:09.331452 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 116/249] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:09 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:09.480081 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-95188d64-abc2-4f84-924a-93cb15cf0883 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:09.480737 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-95188d64-abc2-4f84-924a-93cb15cf0883 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:09.486856 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95188d64-abc2-4f84-924a-93cb15cf0883 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:09.487331 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95188d64-abc2-4f84-924a-93cb15cf0883 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:09.487791 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95188d64-abc2-4f84-924a-93cb15cf0883 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:09.488510 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95188d64-abc2-4f84-924a-93cb15cf0883 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:09.489117 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95188d64-abc2-4f84-924a-93cb15cf0883 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:09.490105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95188d64-abc2-4f84-924a-93cb15cf0883 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:09.667120 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-95188d64-abc2-4f84-924a-93cb15cf0883 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:09.677202 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-95188d64-abc2-4f84-924a-93cb15cf0883 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1316 microversion: 2.1 time: 0.200923 Sep 26 05:31:09.677857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 134/250] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:09 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1316 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:09.698544 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c58fba84-5ac6-4a28-84a3-2e4a8e133b93 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:09.699193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c58fba84-5ac6-4a28-84a3-2e4a8e133b93 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:09.705269 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c58fba84-5ac6-4a28-84a3-2e4a8e133b93 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:09.705755 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c58fba84-5ac6-4a28-84a3-2e4a8e133b93 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:09.706192 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c58fba84-5ac6-4a28-84a3-2e4a8e133b93 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:09.706884 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c58fba84-5ac6-4a28-84a3-2e4a8e133b93 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:09.708461 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c58fba84-5ac6-4a28-84a3-2e4a8e133b93 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:09.708744 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c58fba84-5ac6-4a28-84a3-2e4a8e133b93 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:09.844284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c58fba84-5ac6-4a28-84a3-2e4a8e133b93 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:09.852923 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c58fba84-5ac6-4a28-84a3-2e4a8e133b93 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.158213 Sep 26 05:31:09.853719 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 117/251] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:09 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:10.073688 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f21c604f-00a9-4931-bc2b-67f99bdee98b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:10.074299 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f21c604f-00a9-4931-bc2b-67f99bdee98b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:10.080346 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f21c604f-00a9-4931-bc2b-67f99bdee98b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:10.080841 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f21c604f-00a9-4931-bc2b-67f99bdee98b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:10.081276 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f21c604f-00a9-4931-bc2b-67f99bdee98b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:10.081965 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f21c604f-00a9-4931-bc2b-67f99bdee98b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:10.083232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f21c604f-00a9-4931-bc2b-67f99bdee98b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:10.083664 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f21c604f-00a9-4931-bc2b-67f99bdee98b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:10.228875 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f21c604f-00a9-4931-bc2b-67f99bdee98b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:10.237273 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f21c604f-00a9-4931-bc2b-67f99bdee98b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:10.238674 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f21c604f-00a9-4931-bc2b-67f99bdee98b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:10.240025 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f21c604f-00a9-4931-bc2b-67f99bdee98b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.170645 Sep 26 05:31:10.240601 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 135/252] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:10 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:10.354541 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b22ca65e-cf69-4bd1-9c33-6abbbae090d3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:10.355154 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b22ca65e-cf69-4bd1-9c33-6abbbae090d3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:10.361209 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b22ca65e-cf69-4bd1-9c33-6abbbae090d3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:10.361685 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b22ca65e-cf69-4bd1-9c33-6abbbae090d3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:10.362119 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b22ca65e-cf69-4bd1-9c33-6abbbae090d3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:10.362801 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b22ca65e-cf69-4bd1-9c33-6abbbae090d3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:10.363272 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b22ca65e-cf69-4bd1-9c33-6abbbae090d3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:10.363694 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b22ca65e-cf69-4bd1-9c33-6abbbae090d3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:10.637078 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b22ca65e-cf69-4bd1-9c33-6abbbae090d3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:10.645676 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b22ca65e-cf69-4bd1-9c33-6abbbae090d3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1364 microversion: 2.1 time: 0.294823 Sep 26 05:31:10.646234 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 118/253] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:10 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1364 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:10.701972 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-14ffa673-f251-4680-b773-4d7de180daae tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:10.702602 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-14ffa673-f251-4680-b773-4d7de180daae tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:10.711772 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-14ffa673-f251-4680-b773-4d7de180daae tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:10.712509 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-14ffa673-f251-4680-b773-4d7de180daae tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:10.714031 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-14ffa673-f251-4680-b773-4d7de180daae tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:10.714908 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-14ffa673-f251-4680-b773-4d7de180daae tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:10.715655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-14ffa673-f251-4680-b773-4d7de180daae tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:10.716419 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-14ffa673-f251-4680-b773-4d7de180daae tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:10.717006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=4 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:10.743656 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=16 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:10.873127 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-14ffa673-f251-4680-b773-4d7de180daae tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:10.877553 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4a2ae872-07df-44a8-afb4-1452f4c18d7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:10.878160 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4a2ae872-07df-44a8-afb4-1452f4c18d7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:10.883329 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-14ffa673-f251-4680-b773-4d7de180daae tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1316 microversion: 2.1 time: 0.186523 Sep 26 05:31:10.884443 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 136/254] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:10 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1316 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:10.885636 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4a2ae872-07df-44a8-afb4-1452f4c18d7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:10.886124 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4a2ae872-07df-44a8-afb4-1452f4c18d7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:10.886585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4a2ae872-07df-44a8-afb4-1452f4c18d7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:10.887259 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4a2ae872-07df-44a8-afb4-1452f4c18d7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:10.887712 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4a2ae872-07df-44a8-afb4-1452f4c18d7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:10.888135 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4a2ae872-07df-44a8-afb4-1452f4c18d7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:10.952576 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=8 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:11.029210 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4a2ae872-07df-44a8-afb4-1452f4c18d7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:11.037361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4a2ae872-07df-44a8-afb4-1452f4c18d7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.164025 Sep 26 05:31:11.038245 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 119/255] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:10 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:11.267648 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-ca854927-e045-4530-9036-64aa12e5277e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:11.268742 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-ca854927-e045-4530-9036-64aa12e5277e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:11.275512 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ca854927-e045-4530-9036-64aa12e5277e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:11.276000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ca854927-e045-4530-9036-64aa12e5277e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:11.276465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ca854927-e045-4530-9036-64aa12e5277e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:11.277153 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ca854927-e045-4530-9036-64aa12e5277e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:11.277598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ca854927-e045-4530-9036-64aa12e5277e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:11.278014 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ca854927-e045-4530-9036-64aa12e5277e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:11.416137 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-ca854927-e045-4530-9036-64aa12e5277e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:11.424300 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-ca854927-e045-4530-9036-64aa12e5277e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:11.425766 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-ca854927-e045-4530-9036-64aa12e5277e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:11.427344 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-ca854927-e045-4530-9036-64aa12e5277e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.164438 Sep 26 05:31:11.427908 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 137/256] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:11 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:11.668935 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-237ad19d-b640-4f04-882f-370c72e4999a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:11.669565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-237ad19d-b640-4f04-882f-370c72e4999a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:11.675510 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-237ad19d-b640-4f04-882f-370c72e4999a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:11.676526 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-237ad19d-b640-4f04-882f-370c72e4999a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:11.677203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-237ad19d-b640-4f04-882f-370c72e4999a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:11.677877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-237ad19d-b640-4f04-882f-370c72e4999a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:11.678326 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-237ad19d-b640-4f04-882f-370c72e4999a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:11.678742 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-237ad19d-b640-4f04-882f-370c72e4999a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:11.819385 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-237ad19d-b640-4f04-882f-370c72e4999a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:11.827869 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-237ad19d-b640-4f04-882f-370c72e4999a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1364 microversion: 2.1 time: 0.162740 Sep 26 05:31:11.828786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 120/257] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:11 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:11.906680 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1f3f7206-bc79-4a46-97f1-85ede759dc87 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:11.907383 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-1f3f7206-bc79-4a46-97f1-85ede759dc87 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:11.914182 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f3f7206-bc79-4a46-97f1-85ede759dc87 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:11.914673 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f3f7206-bc79-4a46-97f1-85ede759dc87 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:11.915114 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f3f7206-bc79-4a46-97f1-85ede759dc87 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:11.915811 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f3f7206-bc79-4a46-97f1-85ede759dc87 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:11.916287 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f3f7206-bc79-4a46-97f1-85ede759dc87 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:11.916726 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f3f7206-bc79-4a46-97f1-85ede759dc87 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:12.046016 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1f3f7206-bc79-4a46-97f1-85ede759dc87 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:12.054424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1f3f7206-bc79-4a46-97f1-85ede759dc87 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1505 microversion: 2.1 time: 0.151678 Sep 26 05:31:12.055084 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 138/258] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:11 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:12.061351 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-37457eec-798b-4d05-89b4-8444dacd2abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:12.062046 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-37457eec-798b-4d05-89b4-8444dacd2abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:12.064536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:12.069901 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-37457eec-798b-4d05-89b4-8444dacd2abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:12.070383 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-37457eec-798b-4d05-89b4-8444dacd2abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:12.070993 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-37457eec-798b-4d05-89b4-8444dacd2abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:12.071685 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-37457eec-798b-4d05-89b4-8444dacd2abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:12.072187 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-37457eec-798b-4d05-89b4-8444dacd2abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:12.072699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-37457eec-798b-4d05-89b4-8444dacd2abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:12.240361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-37457eec-798b-4d05-89b4-8444dacd2abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:12.266864 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-37457eec-798b-4d05-89b4-8444dacd2abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.209290 Sep 26 05:31:12.267633 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 121/259] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:12 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:12.455941 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7754a446-c5ed-4063-84f6-f145508cc540 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:12.457223 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7754a446-c5ed-4063-84f6-f145508cc540 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:12.464598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7754a446-c5ed-4063-84f6-f145508cc540 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:12.465462 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7754a446-c5ed-4063-84f6-f145508cc540 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:12.465995 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7754a446-c5ed-4063-84f6-f145508cc540 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:12.466928 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7754a446-c5ed-4063-84f6-f145508cc540 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:12.468466 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7754a446-c5ed-4063-84f6-f145508cc540 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:12.469123 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7754a446-c5ed-4063-84f6-f145508cc540 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:12.647273 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7754a446-c5ed-4063-84f6-f145508cc540 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:12.655667 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7754a446-c5ed-4063-84f6-f145508cc540 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:12.657367 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7754a446-c5ed-4063-84f6-f145508cc540 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:12.658933 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7754a446-c5ed-4063-84f6-f145508cc540 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.209127 Sep 26 05:31:12.659809 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 139/260] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:12 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:12.850942 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f2995ec3-a8ed-49ba-9b28-af02961d3058 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:12.851551 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f2995ec3-a8ed-49ba-9b28-af02961d3058 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:12.857610 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f2995ec3-a8ed-49ba-9b28-af02961d3058 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:12.858385 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f2995ec3-a8ed-49ba-9b28-af02961d3058 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:12.858897 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f2995ec3-a8ed-49ba-9b28-af02961d3058 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:12.859606 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f2995ec3-a8ed-49ba-9b28-af02961d3058 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:12.860082 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f2995ec3-a8ed-49ba-9b28-af02961d3058 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:12.860534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f2995ec3-a8ed-49ba-9b28-af02961d3058 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:12.986889 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f2995ec3-a8ed-49ba-9b28-af02961d3058 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:12.994591 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f2995ec3-a8ed-49ba-9b28-af02961d3058 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1364 microversion: 2.1 time: 0.147736 Sep 26 05:31:12.995156 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 122/261] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:12 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:13.236671 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-adc049d7-03ee-4f73-89c6-0c9f8f64fbcc req-e78bd5d3-df5c-41df-b62b-166d8a116845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de4a6090-4a17-4d48-806a-1fbfb8556e47", "name": "network-vif-plugged", "status": "completed", "tag": "6c8f3d3c-69f4-4522-90e1-444ce9de2135"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:13.248293 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-adc049d7-03ee-4f73-89c6-0c9f8f64fbcc req-e78bd5d3-df5c-41df-b62b-166d8a116845 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:13.248799 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-adc049d7-03ee-4f73-89c6-0c9f8f64fbcc req-e78bd5d3-df5c-41df-b62b-166d8a116845 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:13.249259 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-adc049d7-03ee-4f73-89c6-0c9f8f64fbcc req-e78bd5d3-df5c-41df-b62b-166d8a116845 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:13.262267 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-adc049d7-03ee-4f73-89c6-0c9f8f64fbcc req-e78bd5d3-df5c-41df-b62b-166d8a116845 service nova] Creating event network-vif-plugged:6c8f3d3c-69f4-4522-90e1-444ce9de2135 for instance de4a6090-4a17-4d48-806a-1fbfb8556e47 on hv-cinder-85918 Sep 26 05:31:13.267938 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-adc049d7-03ee-4f73-89c6-0c9f8f64fbcc req-e78bd5d3-df5c-41df-b62b-166d8a116845 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035141 Sep 26 05:31:13.268987 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 140/262] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:31:13.293069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-00276719-7e33-4718-8da9-63503a4bcfe8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:13.294221 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-00276719-7e33-4718-8da9-63503a4bcfe8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:13.321234 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-00276719-7e33-4718-8da9-63503a4bcfe8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:13.322233 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-00276719-7e33-4718-8da9-63503a4bcfe8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:13.322746 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-00276719-7e33-4718-8da9-63503a4bcfe8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:13.323508 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-00276719-7e33-4718-8da9-63503a4bcfe8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:13.324238 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-00276719-7e33-4718-8da9-63503a4bcfe8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:13.324782 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-00276719-7e33-4718-8da9-63503a4bcfe8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:13.462787 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-00276719-7e33-4718-8da9-63503a4bcfe8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:13.470782 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-00276719-7e33-4718-8da9-63503a4bcfe8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.183664 Sep 26 05:31:13.471338 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 123/263] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:13 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:13.687200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-94bc6864-c169-4f77-8634-06c8dc401f41 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:13.688142 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-94bc6864-c169-4f77-8634-06c8dc401f41 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:13.695653 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-94bc6864-c169-4f77-8634-06c8dc401f41 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:13.696145 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-94bc6864-c169-4f77-8634-06c8dc401f41 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:13.696624 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-94bc6864-c169-4f77-8634-06c8dc401f41 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:13.697322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-94bc6864-c169-4f77-8634-06c8dc401f41 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:13.697776 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-94bc6864-c169-4f77-8634-06c8dc401f41 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:13.698202 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-94bc6864-c169-4f77-8634-06c8dc401f41 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:13.844057 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-94bc6864-c169-4f77-8634-06c8dc401f41 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:13.856532 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-94bc6864-c169-4f77-8634-06c8dc401f41 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:13.857984 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-94bc6864-c169-4f77-8634-06c8dc401f41 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:13.859407 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-94bc6864-c169-4f77-8634-06c8dc401f41 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.177948 Sep 26 05:31:13.860277 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 141/264] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:13 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:14.018497 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e14971de-c863-4b14-9ba6-29c1102c801d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:14.019347 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e14971de-c863-4b14-9ba6-29c1102c801d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:14.027873 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e14971de-c863-4b14-9ba6-29c1102c801d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:14.028526 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e14971de-c863-4b14-9ba6-29c1102c801d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:14.028920 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e14971de-c863-4b14-9ba6-29c1102c801d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:14.029618 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e14971de-c863-4b14-9ba6-29c1102c801d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:14.030102 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e14971de-c863-4b14-9ba6-29c1102c801d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:14.030532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e14971de-c863-4b14-9ba6-29c1102c801d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:14.166012 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e14971de-c863-4b14-9ba6-29c1102c801d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:14.173857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e14971de-c863-4b14-9ba6-29c1102c801d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1364 microversion: 2.1 time: 0.159372 Sep 26 05:31:14.174426 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 124/265] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:14 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:14.494236 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d242dc87-76fa-4fa1-a7e3-87ce1f21fb48 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:14.494875 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d242dc87-76fa-4fa1-a7e3-87ce1f21fb48 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:14.500750 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d242dc87-76fa-4fa1-a7e3-87ce1f21fb48 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:14.501234 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d242dc87-76fa-4fa1-a7e3-87ce1f21fb48 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:14.501655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d242dc87-76fa-4fa1-a7e3-87ce1f21fb48 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:14.502333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d242dc87-76fa-4fa1-a7e3-87ce1f21fb48 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:14.502779 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d242dc87-76fa-4fa1-a7e3-87ce1f21fb48 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:14.503199 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d242dc87-76fa-4fa1-a7e3-87ce1f21fb48 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:14.631448 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d242dc87-76fa-4fa1-a7e3-87ce1f21fb48 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:14.640449 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d242dc87-76fa-4fa1-a7e3-87ce1f21fb48 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.149805 Sep 26 05:31:14.650566 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 142/266] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:14 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:14.886493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2e38db91-9543-4d10-baac-d6d6792c5bc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:14.887005 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2e38db91-9543-4d10-baac-d6d6792c5bc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:14.893642 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e38db91-9543-4d10-baac-d6d6792c5bc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:14.894118 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e38db91-9543-4d10-baac-d6d6792c5bc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:14.894644 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e38db91-9543-4d10-baac-d6d6792c5bc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:14.895319 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e38db91-9543-4d10-baac-d6d6792c5bc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:14.895759 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e38db91-9543-4d10-baac-d6d6792c5bc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:14.896172 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e38db91-9543-4d10-baac-d6d6792c5bc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:15.029868 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2e38db91-9543-4d10-baac-d6d6792c5bc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:15.038824 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2e38db91-9543-4d10-baac-d6d6792c5bc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:15.040415 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2e38db91-9543-4d10-baac-d6d6792c5bc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:15.041657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2e38db91-9543-4d10-baac-d6d6792c5bc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.159214 Sep 26 05:31:15.042291 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 125/267] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:14 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:15.196985 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-51e450f3-9cc5-416a-b7e7-0329db25b55b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:15.197683 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-51e450f3-9cc5-416a-b7e7-0329db25b55b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:15.204296 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-51e450f3-9cc5-416a-b7e7-0329db25b55b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:15.204963 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-51e450f3-9cc5-416a-b7e7-0329db25b55b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:15.205515 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-51e450f3-9cc5-416a-b7e7-0329db25b55b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:15.206321 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-51e450f3-9cc5-416a-b7e7-0329db25b55b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:15.206835 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-51e450f3-9cc5-416a-b7e7-0329db25b55b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:15.207322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-51e450f3-9cc5-416a-b7e7-0329db25b55b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:15.338471 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-51e450f3-9cc5-416a-b7e7-0329db25b55b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:15.346201 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-51e450f3-9cc5-416a-b7e7-0329db25b55b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1364 microversion: 2.1 time: 0.153981 Sep 26 05:31:15.346831 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 143/268] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:15 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:15.664018 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2a99fa16-b8ee-404a-a5ca-3d95d11c2858 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:15.664724 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2a99fa16-b8ee-404a-a5ca-3d95d11c2858 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:15.671834 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a99fa16-b8ee-404a-a5ca-3d95d11c2858 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:15.672509 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a99fa16-b8ee-404a-a5ca-3d95d11c2858 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:15.673101 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a99fa16-b8ee-404a-a5ca-3d95d11c2858 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:15.673936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a99fa16-b8ee-404a-a5ca-3d95d11c2858 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:15.674582 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a99fa16-b8ee-404a-a5ca-3d95d11c2858 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:15.675244 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a99fa16-b8ee-404a-a5ca-3d95d11c2858 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:15.843267 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2a99fa16-b8ee-404a-a5ca-3d95d11c2858 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:15.855923 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2a99fa16-b8ee-404a-a5ca-3d95d11c2858 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.196494 Sep 26 05:31:15.856847 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 126/269] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:15 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:16.068703 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-974f8983-d8d3-40b0-b4d4-ebd038da069b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:16.069427 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-974f8983-d8d3-40b0-b4d4-ebd038da069b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:16.076005 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-974f8983-d8d3-40b0-b4d4-ebd038da069b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:16.076619 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-974f8983-d8d3-40b0-b4d4-ebd038da069b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:16.077120 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-974f8983-d8d3-40b0-b4d4-ebd038da069b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:16.077925 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-974f8983-d8d3-40b0-b4d4-ebd038da069b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:16.078449 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-974f8983-d8d3-40b0-b4d4-ebd038da069b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:16.079056 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-974f8983-d8d3-40b0-b4d4-ebd038da069b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:16.371690 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-66720f96-f110-407a-9113-9adbcf62fdb5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:16.372339 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-66720f96-f110-407a-9113-9adbcf62fdb5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:16.382175 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66720f96-f110-407a-9113-9adbcf62fdb5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:16.382669 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66720f96-f110-407a-9113-9adbcf62fdb5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:16.384060 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66720f96-f110-407a-9113-9adbcf62fdb5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:16.384804 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66720f96-f110-407a-9113-9adbcf62fdb5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:16.385269 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66720f96-f110-407a-9113-9adbcf62fdb5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:16.385703 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66720f96-f110-407a-9113-9adbcf62fdb5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:16.497894 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-974f8983-d8d3-40b0-b4d4-ebd038da069b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:16.509867 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-974f8983-d8d3-40b0-b4d4-ebd038da069b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:16.511638 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-974f8983-d8d3-40b0-b4d4-ebd038da069b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:16.513237 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-974f8983-d8d3-40b0-b4d4-ebd038da069b tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.449007 Sep 26 05:31:16.514574 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 144/270] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:16 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:16.527246 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-33d5f69c-0819-4130-9331-ed3116c8c092 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1075189159", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1112145332", "security_groups": [{"name": "tempest-secgroup-smoke-1386141646"}], "networks": [{"uuid": "73121f4e-6b77-45b6-a1f2-7577a1a4a779"}], "block_device_mapping_v2": [{"uuid": "562ed086-b67d-4f4e-bd18-00d317a1c554", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:16.551352 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:16.594929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-66720f96-f110-407a-9113-9adbcf62fdb5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:16.605616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-66720f96-f110-407a-9113-9adbcf62fdb5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1364 microversion: 2.1 time: 0.238411 Sep 26 05:31:16.616273 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 127/271] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:16 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:16.698449 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.network.neutron [None req-33d5f69c-0819-4130-9331-ed3116c8c092 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] validate_networks() for [('73121f4e-6b77-45b6-a1f2-7577a1a4a779', None, None, None, None, None)] {{(pid=120806) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:31:16.879409 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f836b023-fb1c-4451-a6f6-d30421d5dc4a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:16.880115 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f836b023-fb1c-4451-a6f6-d30421d5dc4a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:16.886373 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f836b023-fb1c-4451-a6f6-d30421d5dc4a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:16.887110 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f836b023-fb1c-4451-a6f6-d30421d5dc4a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:16.887618 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f836b023-fb1c-4451-a6f6-d30421d5dc4a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:16.888545 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f836b023-fb1c-4451-a6f6-d30421d5dc4a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:16.889010 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f836b023-fb1c-4451-a6f6-d30421d5dc4a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:16.889435 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f836b023-fb1c-4451-a6f6-d30421d5dc4a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:17.110490 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f836b023-fb1c-4451-a6f6-d30421d5dc4a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:17.113749 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:17.122003 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f836b023-fb1c-4451-a6f6-d30421d5dc4a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.246819 Sep 26 05:31:17.123356 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 128/272] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:16 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:17.206200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-33d5f69c-0819-4130-9331-ed3116c8c092 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Flavor limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:31:17.206901 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-33d5f69c-0819-4130-9331-ed3116c8c092 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Image limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:31:17.208479 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-33d5f69c-0819-4130-9331-ed3116c8c092 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Flavor pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:31:17.208990 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-33d5f69c-0819-4130-9331-ed3116c8c092 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Image pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:31:17.209471 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-33d5f69c-0819-4130-9331-ed3116c8c092 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:31:17.218583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-33d5f69c-0819-4130-9331-ed3116c8c092 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:17.218848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c9028ab1-7bf3-4392-8ae1-e031df69d599 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Action: 'create', calling method: .version_select at 0x7fd7b75333a0>, body: {"keypair": {"name": "tempest-keypair-1873336703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZsCTUYt3RxiUg9QcZbUsElw7HyrQ31FzLCPQvNJXJ6ebUXUWjz5xAbiLhkw406eEc2NNbJpR//DaMywayeTyTI2+z5XPrZ729DZgsq1HnkjqN5v5o6b3aveZqQzpyYWA=="}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:17.219212 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-33d5f69c-0819-4130-9331-ed3116c8c092 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:17.219718 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-33d5f69c-0819-4130-9331-ed3116c8c092 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:17.220610 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-33d5f69c-0819-4130-9331-ed3116c8c092 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:17.221276 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-33d5f69c-0819-4130-9331-ed3116c8c092 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:17.221766 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-33d5f69c-0819-4130-9331-ed3116c8c092 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:17.236481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-c9028ab1-7bf3-4392-8ae1-e031df69d599 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Getting quotas for project fd13dd8ec810435491e3f3cba7cca4d1. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:31:17.248438 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-c9028ab1-7bf3-4392-8ae1-e031df69d599 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Getting quotas for user 48e588ff6d5a4a37b902abadfb6d04fc and project fd13dd8ec810435491e3f3cba7cca4d1. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:31:17.248549 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-33d5f69c-0819-4130-9331-ed3116c8c092 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Getting quotas for project e1b5f9daf8d44a6987bbff8939ed7c92. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:31:17.250542 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-33d5f69c-0819-4130-9331-ed3116c8c092 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Getting quotas for user a0794e19f43a413db886750b0517d3d3 and project e1b5f9daf8d44a6987bbff8939ed7c92. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:31:17.275272 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c9028ab1-7bf3-4392-8ae1-e031df69d599 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059946 Sep 26 05:31:17.276051 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 129/273] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 05:31:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:31:17.320961 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-33d5f69c-0819-4130-9331-ed3116c8c092 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Going to run 1 instances... {{(pid=120806) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:31:17.323326 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-33d5f69c-0819-4130-9331-ed3116c8c092 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='562ed086-b67d-4f4e-bd18-00d317a1c554',volume_size=None,volume_type=None)] {{(pid=120806) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:31:17.491618 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-33d5f69c-0819-4130-9331-ed3116c8c092 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.975676 Sep 26 05:31:17.492509 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 145/274] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:31:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:31:17.504393 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fe210cd1-f796-4fd7-b452-09481b792b8b tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:17.505764 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fe210cd1-f796-4fd7-b452-09481b792b8b tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:17.554341 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1a43bba9-709d-424e-a6d8-585a481ccf69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:17.554961 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-1a43bba9-709d-424e-a6d8-585a481ccf69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:17.564494 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1a43bba9-709d-424e-a6d8-585a481ccf69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:17.565010 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1a43bba9-709d-424e-a6d8-585a481ccf69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:17.565455 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1a43bba9-709d-424e-a6d8-585a481ccf69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:17.566506 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1a43bba9-709d-424e-a6d8-585a481ccf69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:17.566983 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1a43bba9-709d-424e-a6d8-585a481ccf69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:17.567417 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1a43bba9-709d-424e-a6d8-585a481ccf69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:17.570401 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fe210cd1-f796-4fd7-b452-09481b792b8b tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:17.583349 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fe210cd1-f796-4fd7-b452-09481b792b8b tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1089 microversion: 2.1 time: 0.082835 Sep 26 05:31:17.584225 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 130/275] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:17 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1089 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:17.635427 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2925b019-0225-4c2e-b7f9-8971603a63b2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:17.637126 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2925b019-0225-4c2e-b7f9-8971603a63b2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:17.662299 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2925b019-0225-4c2e-b7f9-8971603a63b2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:17.662839 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2925b019-0225-4c2e-b7f9-8971603a63b2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:17.663516 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2925b019-0225-4c2e-b7f9-8971603a63b2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:17.666012 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2925b019-0225-4c2e-b7f9-8971603a63b2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:17.666643 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2925b019-0225-4c2e-b7f9-8971603a63b2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:17.667186 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2925b019-0225-4c2e-b7f9-8971603a63b2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:17.855138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1a43bba9-709d-424e-a6d8-585a481ccf69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:17.875095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1a43bba9-709d-424e-a6d8-585a481ccf69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:17.880630 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1a43bba9-709d-424e-a6d8-585a481ccf69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:17.882837 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1a43bba9-709d-424e-a6d8-585a481ccf69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.333040 Sep 26 05:31:17.884353 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 146/276] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:17 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:17.998405 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2925b019-0225-4c2e-b7f9-8971603a63b2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:18.009884 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2925b019-0225-4c2e-b7f9-8971603a63b2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1549 microversion: 2.1 time: 0.380466 Sep 26 05:31:18.010578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 131/277] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:17 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1549 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:18.034500 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-809ca935-68e1-4c11-8a6c-52b071855558 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:18.034823 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-809ca935-68e1-4c11-8a6c-52b071855558 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:18.045217 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-809ca935-68e1-4c11-8a6c-52b071855558 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:18.045728 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-809ca935-68e1-4c11-8a6c-52b071855558 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:18.046404 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-809ca935-68e1-4c11-8a6c-52b071855558 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:18.046987 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-809ca935-68e1-4c11-8a6c-52b071855558 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:18.047461 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-809ca935-68e1-4c11-8a6c-52b071855558 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:18.047919 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-809ca935-68e1-4c11-8a6c-52b071855558 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:18.152407 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-031da17d-2fc8-43d1-ab02-afa67be29ccd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:18.152407 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-031da17d-2fc8-43d1-ab02-afa67be29ccd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:18.158518 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-031da17d-2fc8-43d1-ab02-afa67be29ccd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:18.159251 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-031da17d-2fc8-43d1-ab02-afa67be29ccd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:18.160303 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-031da17d-2fc8-43d1-ab02-afa67be29ccd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:18.161534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-031da17d-2fc8-43d1-ab02-afa67be29ccd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:18.162992 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-031da17d-2fc8-43d1-ab02-afa67be29ccd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:18.163829 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-031da17d-2fc8-43d1-ab02-afa67be29ccd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:18.195917 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-809ca935-68e1-4c11-8a6c-52b071855558 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.165717 Sep 26 05:31:18.197283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 147/278] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 05:31:18 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47/os-interface => generated 285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:31:18.402467 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-031da17d-2fc8-43d1-ab02-afa67be29ccd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:18.413809 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-031da17d-2fc8-43d1-ab02-afa67be29ccd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.269719 Sep 26 05:31:18.415205 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 132/279] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:18 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:18.616289 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-42d5e74e-2f40-46de-991e-9f475714dfe2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:18.617055 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-42d5e74e-2f40-46de-991e-9f475714dfe2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:18.624535 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-42d5e74e-2f40-46de-991e-9f475714dfe2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:18.625117 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-42d5e74e-2f40-46de-991e-9f475714dfe2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:18.625627 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-42d5e74e-2f40-46de-991e-9f475714dfe2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:18.626383 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-42d5e74e-2f40-46de-991e-9f475714dfe2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:18.627192 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-42d5e74e-2f40-46de-991e-9f475714dfe2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:18.627674 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-42d5e74e-2f40-46de-991e-9f475714dfe2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:18.710204 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-42d5e74e-2f40-46de-991e-9f475714dfe2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:18.721930 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-42d5e74e-2f40-46de-991e-9f475714dfe2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1139 microversion: 2.1 time: 0.110155 Sep 26 05:31:18.723998 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 148/280] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:18 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1139 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:18.913253 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-02c3e87e-19c6-4c9c-9b1c-f2df61bfac9d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:18.914719 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-02c3e87e-19c6-4c9c-9b1c-f2df61bfac9d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:18.921679 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-02c3e87e-19c6-4c9c-9b1c-f2df61bfac9d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:18.922294 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-02c3e87e-19c6-4c9c-9b1c-f2df61bfac9d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:18.922883 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-02c3e87e-19c6-4c9c-9b1c-f2df61bfac9d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:18.923683 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-02c3e87e-19c6-4c9c-9b1c-f2df61bfac9d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:18.924422 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-02c3e87e-19c6-4c9c-9b1c-f2df61bfac9d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:18.925046 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-02c3e87e-19c6-4c9c-9b1c-f2df61bfac9d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:19.231282 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-02c3e87e-19c6-4c9c-9b1c-f2df61bfac9d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:19.244933 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-02c3e87e-19c6-4c9c-9b1c-f2df61bfac9d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:19.249055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-02c3e87e-19c6-4c9c-9b1c-f2df61bfac9d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:19.250752 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-02c3e87e-19c6-4c9c-9b1c-f2df61bfac9d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.342087 Sep 26 05:31:19.252378 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 133/281] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:18 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:19.401850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b900934a-d427-474e-8dc2-22dc17a436aa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1430109056", "imageRef": "d37a4f3d-6311-48af-9e33-4c62c14cdd1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "542c3891-aa7c-4297-a50e-fe5b71cd3cf3"}], "security_groups": [{"name": "tempest-securitygroup--1152802332"}], "key_name": "tempest-keypair-1873336703", "user_data": "}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:19.437256 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8e19530e-8fb8-4e44-b851-826d30de9296 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:19.437961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8e19530e-8fb8-4e44-b851-826d30de9296 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:19.447937 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8e19530e-8fb8-4e44-b851-826d30de9296 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:19.450527 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8e19530e-8fb8-4e44-b851-826d30de9296 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:19.451061 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8e19530e-8fb8-4e44-b851-826d30de9296 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:19.451842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8e19530e-8fb8-4e44-b851-826d30de9296 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:19.453230 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8e19530e-8fb8-4e44-b851-826d30de9296 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:19.453898 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8e19530e-8fb8-4e44-b851-826d30de9296 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:19.562469 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.network.neutron [None req-b900934a-d427-474e-8dc2-22dc17a436aa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] validate_networks() for [('542c3891-aa7c-4297-a50e-fe5b71cd3cf3', None, None, None, None, None)] {{(pid=120806) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:31:19.688922 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8e19530e-8fb8-4e44-b851-826d30de9296 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:19.697727 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8e19530e-8fb8-4e44-b851-826d30de9296 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.264865 Sep 26 05:31:19.698880 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 134/282] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:19 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:19.704157 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-6b3f02ac-4281-4fc1-9bc1-86910dfab962 req-5a3ab9d5-fbab-4a0c-8874-7c34030a0c1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de4a6090-4a17-4d48-806a-1fbfb8556e47", "tag": "6c8f3d3c-69f4-4522-90e1-444ce9de2135"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:19.713578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-6b3f02ac-4281-4fc1-9bc1-86910dfab962 req-5a3ab9d5-fbab-4a0c-8874-7c34030a0c1f service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:19.714384 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-6b3f02ac-4281-4fc1-9bc1-86910dfab962 req-5a3ab9d5-fbab-4a0c-8874-7c34030a0c1f service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:19.714873 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-6b3f02ac-4281-4fc1-9bc1-86910dfab962 req-5a3ab9d5-fbab-4a0c-8874-7c34030a0c1f service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:19.726837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-6b3f02ac-4281-4fc1-9bc1-86910dfab962 req-5a3ab9d5-fbab-4a0c-8874-7c34030a0c1f service nova] Creating event network-changed:6c8f3d3c-69f4-4522-90e1-444ce9de2135 for instance de4a6090-4a17-4d48-806a-1fbfb8556e47 on hv-cinder-85918 Sep 26 05:31:19.732062 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-6b3f02ac-4281-4fc1-9bc1-86910dfab962 req-5a3ab9d5-fbab-4a0c-8874-7c34030a0c1f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031871 Sep 26 05:31:19.733088 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 135/283] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:31:19.750155 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-19552d06-eaa6-4036-aedc-c5979088cf30 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:19.750850 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-19552d06-eaa6-4036-aedc-c5979088cf30 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:19.757654 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-19552d06-eaa6-4036-aedc-c5979088cf30 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:19.758136 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-19552d06-eaa6-4036-aedc-c5979088cf30 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:19.758567 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-19552d06-eaa6-4036-aedc-c5979088cf30 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:19.759308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-19552d06-eaa6-4036-aedc-c5979088cf30 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:19.759943 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-19552d06-eaa6-4036-aedc-c5979088cf30 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:19.760398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-19552d06-eaa6-4036-aedc-c5979088cf30 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:19.850647 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-19552d06-eaa6-4036-aedc-c5979088cf30 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:19.861473 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-19552d06-eaa6-4036-aedc-c5979088cf30 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1131 microversion: 2.1 time: 0.114284 Sep 26 05:31:19.862101 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 136/284] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:19 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1131 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:20.054800 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-b900934a-d427-474e-8dc2-22dc17a436aa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Flavor limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:31:20.055696 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-b900934a-d427-474e-8dc2-22dc17a436aa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Image limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:31:20.056396 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-b900934a-d427-474e-8dc2-22dc17a436aa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Flavor pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:31:20.057293 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-b900934a-d427-474e-8dc2-22dc17a436aa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Image pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:31:20.058246 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-b900934a-d427-474e-8dc2-22dc17a436aa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:31:20.069900 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b900934a-d427-474e-8dc2-22dc17a436aa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:20.070930 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b900934a-d427-474e-8dc2-22dc17a436aa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:20.071605 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b900934a-d427-474e-8dc2-22dc17a436aa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:20.072684 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b900934a-d427-474e-8dc2-22dc17a436aa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:20.073371 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b900934a-d427-474e-8dc2-22dc17a436aa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:20.074125 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b900934a-d427-474e-8dc2-22dc17a436aa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:20.110477 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-b900934a-d427-474e-8dc2-22dc17a436aa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Getting quotas for project fd13dd8ec810435491e3f3cba7cca4d1. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:31:20.116849 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-b900934a-d427-474e-8dc2-22dc17a436aa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Getting quotas for user 48e588ff6d5a4a37b902abadfb6d04fc and project fd13dd8ec810435491e3f3cba7cca4d1. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:31:20.128085 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b900934a-d427-474e-8dc2-22dc17a436aa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Going to run 1 instances... {{(pid=120806) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:31:20.130843 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b900934a-d427-474e-8dc2-22dc17a436aa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d37a4f3d-6311-48af-9e33-4c62c14cdd1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120806) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:31:20.184760 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b900934a-d427-474e-8dc2-22dc17a436aa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.786956 Sep 26 05:31:20.185691 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 149/285] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:31:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:31:20.197174 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c83fbb6a-4157-4a0e-83bb-5dff1f5b3662 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:20.197785 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c83fbb6a-4157-4a0e-83bb-5dff1f5b3662 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:20.271019 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c83fbb6a-4157-4a0e-83bb-5dff1f5b3662 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:20.277821 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-95ae2150-1d69-4a3f-930b-2956ce028df9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:20.278624 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-95ae2150-1d69-4a3f-930b-2956ce028df9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:20.291107 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c83fbb6a-4157-4a0e-83bb-5dff1f5b3662 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1242 microversion: 2.1 time: 0.097632 Sep 26 05:31:20.294916 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95ae2150-1d69-4a3f-930b-2956ce028df9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:20.296872 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 137/286] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:20 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1242 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:20.298889 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95ae2150-1d69-4a3f-930b-2956ce028df9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:20.301988 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95ae2150-1d69-4a3f-930b-2956ce028df9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:20.304827 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95ae2150-1d69-4a3f-930b-2956ce028df9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:20.305385 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95ae2150-1d69-4a3f-930b-2956ce028df9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:20.305908 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95ae2150-1d69-4a3f-930b-2956ce028df9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:20.537665 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-95ae2150-1d69-4a3f-930b-2956ce028df9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:20.541333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=100 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:20.548237 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-95ae2150-1d69-4a3f-930b-2956ce028df9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:20.549775 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-95ae2150-1d69-4a3f-930b-2956ce028df9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:20.552080 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-95ae2150-1d69-4a3f-930b-2956ce028df9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.278123 Sep 26 05:31:20.553859 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 150/287] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:20 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:31:20.721412 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-821ae89d-dc2c-4935-87e8-b7aa0ef3a928 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:20.722032 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-821ae89d-dc2c-4935-87e8-b7aa0ef3a928 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:20.729362 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-821ae89d-dc2c-4935-87e8-b7aa0ef3a928 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:20.729782 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-821ae89d-dc2c-4935-87e8-b7aa0ef3a928 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:20.730445 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-821ae89d-dc2c-4935-87e8-b7aa0ef3a928 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:20.731148 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-821ae89d-dc2c-4935-87e8-b7aa0ef3a928 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:20.731599 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-821ae89d-dc2c-4935-87e8-b7aa0ef3a928 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:20.732019 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-821ae89d-dc2c-4935-87e8-b7aa0ef3a928 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:20.881432 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-821ae89d-dc2c-4935-87e8-b7aa0ef3a928 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:20.888856 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-694f80e3-b234-4b84-a84d-bbbf58b9b5e1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:20.889481 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-694f80e3-b234-4b84-a84d-bbbf58b9b5e1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:20.889829 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-821ae89d-dc2c-4935-87e8-b7aa0ef3a928 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.172254 Sep 26 05:31:20.890477 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 138/288] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:20 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:20.897379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-694f80e3-b234-4b84-a84d-bbbf58b9b5e1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:20.897871 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-694f80e3-b234-4b84-a84d-bbbf58b9b5e1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:20.898392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-694f80e3-b234-4b84-a84d-bbbf58b9b5e1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:20.899100 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-694f80e3-b234-4b84-a84d-bbbf58b9b5e1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:20.899569 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-694f80e3-b234-4b84-a84d-bbbf58b9b5e1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:20.899986 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-694f80e3-b234-4b84-a84d-bbbf58b9b5e1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:20.977828 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-694f80e3-b234-4b84-a84d-bbbf58b9b5e1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:20.985946 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-694f80e3-b234-4b84-a84d-bbbf58b9b5e1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1187 microversion: 2.1 time: 0.101573 Sep 26 05:31:20.986507 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 151/289] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:20 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1187 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:21.323344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a07fdda4-745d-4fc1-96e4-5084e2eb4048 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:21.323962 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a07fdda4-745d-4fc1-96e4-5084e2eb4048 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:21.336790 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a07fdda4-745d-4fc1-96e4-5084e2eb4048 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:21.337603 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a07fdda4-745d-4fc1-96e4-5084e2eb4048 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:21.338207 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a07fdda4-745d-4fc1-96e4-5084e2eb4048 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:21.339069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a07fdda4-745d-4fc1-96e4-5084e2eb4048 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:21.339676 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a07fdda4-745d-4fc1-96e4-5084e2eb4048 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:21.340269 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a07fdda4-745d-4fc1-96e4-5084e2eb4048 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:21.422955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a07fdda4-745d-4fc1-96e4-5084e2eb4048 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:21.432265 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a07fdda4-745d-4fc1-96e4-5084e2eb4048 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1238 microversion: 2.1 time: 0.112688 Sep 26 05:31:21.432847 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 139/290] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:21 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1238 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:21.585824 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a919c3ec-36de-48a3-8c1b-3467ae6657a6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:21.587422 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a919c3ec-36de-48a3-8c1b-3467ae6657a6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:21.596789 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a919c3ec-36de-48a3-8c1b-3467ae6657a6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:21.597328 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a919c3ec-36de-48a3-8c1b-3467ae6657a6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:21.597767 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a919c3ec-36de-48a3-8c1b-3467ae6657a6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:21.599572 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a919c3ec-36de-48a3-8c1b-3467ae6657a6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:21.601248 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a919c3ec-36de-48a3-8c1b-3467ae6657a6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:21.602837 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a919c3ec-36de-48a3-8c1b-3467ae6657a6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:21.914863 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-87a18233-12c1-4fba-afe6-c568e98eb2c7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:21.915886 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-87a18233-12c1-4fba-afe6-c568e98eb2c7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:21.922140 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87a18233-12c1-4fba-afe6-c568e98eb2c7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:21.922723 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87a18233-12c1-4fba-afe6-c568e98eb2c7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:21.923245 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87a18233-12c1-4fba-afe6-c568e98eb2c7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:21.924795 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87a18233-12c1-4fba-afe6-c568e98eb2c7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:21.925439 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87a18233-12c1-4fba-afe6-c568e98eb2c7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:21.926652 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87a18233-12c1-4fba-afe6-c568e98eb2c7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:21.984441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a919c3ec-36de-48a3-8c1b-3467ae6657a6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:22.000023 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a919c3ec-36de-48a3-8c1b-3467ae6657a6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:22.004062 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a919c3ec-36de-48a3-8c1b-3467ae6657a6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:22.006329 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a919c3ec-36de-48a3-8c1b-3467ae6657a6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.425574 Sep 26 05:31:22.008995 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 152/291] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:21 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:22.015559 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7424d07e-1e1b-4eea-98ef-229b1a7f7df6 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:22.017013 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7424d07e-1e1b-4eea-98ef-229b1a7f7df6 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:22.025737 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7424d07e-1e1b-4eea-98ef-229b1a7f7df6 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:22.026600 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7424d07e-1e1b-4eea-98ef-229b1a7f7df6 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:22.027268 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7424d07e-1e1b-4eea-98ef-229b1a7f7df6 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:22.028501 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7424d07e-1e1b-4eea-98ef-229b1a7f7df6 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:22.029491 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7424d07e-1e1b-4eea-98ef-229b1a7f7df6 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:22.030292 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7424d07e-1e1b-4eea-98ef-229b1a7f7df6 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:22.165329 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7424d07e-1e1b-4eea-98ef-229b1a7f7df6 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:22.173144 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7424d07e-1e1b-4eea-98ef-229b1a7f7df6 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1205 microversion: 2.1 time: 0.162815 Sep 26 05:31:22.178637 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 153/292] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:22 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1205 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:22.217379 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-87a18233-12c1-4fba-afe6-c568e98eb2c7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:22.231578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-87a18233-12c1-4fba-afe6-c568e98eb2c7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.322092 Sep 26 05:31:22.242606 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 140/293] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:21 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:22.456483 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-55d21449-89fd-4980-82a3-38802c9481e3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:22.458247 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-55d21449-89fd-4980-82a3-38802c9481e3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:22.465446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-55d21449-89fd-4980-82a3-38802c9481e3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:22.466033 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-55d21449-89fd-4980-82a3-38802c9481e3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:22.466569 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-55d21449-89fd-4980-82a3-38802c9481e3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:22.467361 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-55d21449-89fd-4980-82a3-38802c9481e3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:22.467905 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-55d21449-89fd-4980-82a3-38802c9481e3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:22.468700 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-55d21449-89fd-4980-82a3-38802c9481e3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:22.654503 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-55d21449-89fd-4980-82a3-38802c9481e3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:22.668344 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-55d21449-89fd-4980-82a3-38802c9481e3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1302 microversion: 2.1 time: 0.215752 Sep 26 05:31:22.670509 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 154/294] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:22 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1302 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:23.034286 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5a6bd678-1238-40c4-88d4-3710c82e38a9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:23.035161 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5a6bd678-1238-40c4-88d4-3710c82e38a9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:23.042045 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a6bd678-1238-40c4-88d4-3710c82e38a9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:23.042528 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a6bd678-1238-40c4-88d4-3710c82e38a9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:23.042960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a6bd678-1238-40c4-88d4-3710c82e38a9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:23.049903 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a6bd678-1238-40c4-88d4-3710c82e38a9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:23.050886 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a6bd678-1238-40c4-88d4-3710c82e38a9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:23.051323 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a6bd678-1238-40c4-88d4-3710c82e38a9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:23.202308 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7e92580d-703b-4704-91c1-82e94109ad72 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:23.202978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7e92580d-703b-4704-91c1-82e94109ad72 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:23.209688 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7e92580d-703b-4704-91c1-82e94109ad72 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:23.210161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7e92580d-703b-4704-91c1-82e94109ad72 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:23.210777 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7e92580d-703b-4704-91c1-82e94109ad72 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:23.211526 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7e92580d-703b-4704-91c1-82e94109ad72 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:23.211977 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7e92580d-703b-4704-91c1-82e94109ad72 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:23.212425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7e92580d-703b-4704-91c1-82e94109ad72 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:23.254979 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5a6bd678-1238-40c4-88d4-3710c82e38a9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:23.270515 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5a6bd678-1238-40c4-88d4-3710c82e38a9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:23.284133 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5a6bd678-1238-40c4-88d4-3710c82e38a9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:23.287105 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5a6bd678-1238-40c4-88d4-3710c82e38a9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.256971 Sep 26 05:31:23.288931 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 141/295] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:23 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:23.294314 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-79d5e428-7f7c-447f-8c4c-4b18d6339f19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:23.295178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-79d5e428-7f7c-447f-8c4c-4b18d6339f19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:23.301907 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-79d5e428-7f7c-447f-8c4c-4b18d6339f19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:23.302576 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-79d5e428-7f7c-447f-8c4c-4b18d6339f19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:23.303182 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-79d5e428-7f7c-447f-8c4c-4b18d6339f19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:23.304070 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-79d5e428-7f7c-447f-8c4c-4b18d6339f19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:23.304764 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-79d5e428-7f7c-447f-8c4c-4b18d6339f19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:23.305349 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-79d5e428-7f7c-447f-8c4c-4b18d6339f19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:23.493934 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7e92580d-703b-4704-91c1-82e94109ad72 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:23.509754 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7e92580d-703b-4704-91c1-82e94109ad72 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1261 microversion: 2.1 time: 0.307749 Sep 26 05:31:23.530058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 155/296] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:23 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1261 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:23.639574 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-79d5e428-7f7c-447f-8c4c-4b18d6339f19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:23.648555 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-79d5e428-7f7c-447f-8c4c-4b18d6339f19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.358363 Sep 26 05:31:23.649296 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 142/297] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:23 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:23.698477 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-99d071ca-a388-4923-9324-67eab82a593b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:23.699958 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-99d071ca-a388-4923-9324-67eab82a593b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:23.707203 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-99d071ca-a388-4923-9324-67eab82a593b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:23.708145 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-99d071ca-a388-4923-9324-67eab82a593b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:23.708969 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-99d071ca-a388-4923-9324-67eab82a593b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:23.710154 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-99d071ca-a388-4923-9324-67eab82a593b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:23.711072 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-99d071ca-a388-4923-9324-67eab82a593b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:23.711874 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-99d071ca-a388-4923-9324-67eab82a593b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:23.883867 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-375904f5-59a1-40fd-b073-089defbd80f9 req-4fc16aba-47fe-4090-be9c-b44e685f4c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b60837af-4528-4e98-bb46-0e80e3270c0d", "tag": "7672989d-ca9b-46a1-b56a-6c9d7ec17b2d"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:23.894591 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-375904f5-59a1-40fd-b073-089defbd80f9 req-4fc16aba-47fe-4090-be9c-b44e685f4c42 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:23.895029 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-375904f5-59a1-40fd-b073-089defbd80f9 req-4fc16aba-47fe-4090-be9c-b44e685f4c42 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:23.895455 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-375904f5-59a1-40fd-b073-089defbd80f9 req-4fc16aba-47fe-4090-be9c-b44e685f4c42 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:23.906513 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-375904f5-59a1-40fd-b073-089defbd80f9 req-4fc16aba-47fe-4090-be9c-b44e685f4c42 service nova] Creating event network-changed:7672989d-ca9b-46a1-b56a-6c9d7ec17b2d for instance b60837af-4528-4e98-bb46-0e80e3270c0d on hv-cinder-85918 Sep 26 05:31:23.912172 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-375904f5-59a1-40fd-b073-089defbd80f9 req-4fc16aba-47fe-4090-be9c-b44e685f4c42 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032427 Sep 26 05:31:23.912800 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 143/298] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:31:23.931668 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-99d071ca-a388-4923-9324-67eab82a593b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:23.939675 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-99d071ca-a388-4923-9324-67eab82a593b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1368 microversion: 2.1 time: 0.245257 Sep 26 05:31:23.940287 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 156/299] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:23 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:24.318852 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3357dfbc-536c-470a-803e-84205707d2b4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:24.319586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3357dfbc-536c-470a-803e-84205707d2b4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:24.325745 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3357dfbc-536c-470a-803e-84205707d2b4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:24.326226 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3357dfbc-536c-470a-803e-84205707d2b4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:24.326670 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3357dfbc-536c-470a-803e-84205707d2b4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:24.327346 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3357dfbc-536c-470a-803e-84205707d2b4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:24.327828 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3357dfbc-536c-470a-803e-84205707d2b4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:24.328272 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3357dfbc-536c-470a-803e-84205707d2b4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:24.458216 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3357dfbc-536c-470a-803e-84205707d2b4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:24.466248 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3357dfbc-536c-470a-803e-84205707d2b4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:24.467694 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3357dfbc-536c-470a-803e-84205707d2b4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:24.468867 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3357dfbc-536c-470a-803e-84205707d2b4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.155620 Sep 26 05:31:24.469430 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 144/300] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:24 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:24.536921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d27729b6-ee73-4ff3-bde1-2e43c4ad3fa4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:24.537464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d27729b6-ee73-4ff3-bde1-2e43c4ad3fa4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:24.543259 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d27729b6-ee73-4ff3-bde1-2e43c4ad3fa4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:24.543739 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d27729b6-ee73-4ff3-bde1-2e43c4ad3fa4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:24.544172 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d27729b6-ee73-4ff3-bde1-2e43c4ad3fa4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:24.544872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d27729b6-ee73-4ff3-bde1-2e43c4ad3fa4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:24.545323 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d27729b6-ee73-4ff3-bde1-2e43c4ad3fa4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:24.545745 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d27729b6-ee73-4ff3-bde1-2e43c4ad3fa4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:24.671259 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4abfaff5-adfd-45c7-865a-d08e05143cef tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:24.671870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4abfaff5-adfd-45c7-865a-d08e05143cef tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:24.678536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4abfaff5-adfd-45c7-865a-d08e05143cef tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:24.679027 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4abfaff5-adfd-45c7-865a-d08e05143cef tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:24.679460 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4abfaff5-adfd-45c7-865a-d08e05143cef tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:24.680155 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4abfaff5-adfd-45c7-865a-d08e05143cef tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:24.680635 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4abfaff5-adfd-45c7-865a-d08e05143cef tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:24.681056 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4abfaff5-adfd-45c7-865a-d08e05143cef tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:24.682426 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d27729b6-ee73-4ff3-bde1-2e43c4ad3fa4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:24.690216 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d27729b6-ee73-4ff3-bde1-2e43c4ad3fa4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1261 microversion: 2.1 time: 0.157348 Sep 26 05:31:24.690794 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 157/301] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:24 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:24.856869 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4abfaff5-adfd-45c7-865a-d08e05143cef tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:24.867915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4abfaff5-adfd-45c7-865a-d08e05143cef tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.200445 Sep 26 05:31:24.868527 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 145/302] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:24 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:24.963807 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-04ceb0e8-a2d6-4569-b44a-23f6b44e22f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:24.965180 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-04ceb0e8-a2d6-4569-b44a-23f6b44e22f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:24.971315 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-04ceb0e8-a2d6-4569-b44a-23f6b44e22f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:24.971883 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-04ceb0e8-a2d6-4569-b44a-23f6b44e22f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:24.972453 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-04ceb0e8-a2d6-4569-b44a-23f6b44e22f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:24.973402 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-04ceb0e8-a2d6-4569-b44a-23f6b44e22f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:24.973948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-04ceb0e8-a2d6-4569-b44a-23f6b44e22f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:24.974422 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-04ceb0e8-a2d6-4569-b44a-23f6b44e22f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:25.182206 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-04ceb0e8-a2d6-4569-b44a-23f6b44e22f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:25.191957 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-04ceb0e8-a2d6-4569-b44a-23f6b44e22f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1368 microversion: 2.1 time: 0.231178 Sep 26 05:31:25.192566 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 158/303] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:24 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:25.495705 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-735b295f-2805-4c9f-9dec-37e8c128e927 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:25.496435 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-735b295f-2805-4c9f-9dec-37e8c128e927 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:25.504719 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-735b295f-2805-4c9f-9dec-37e8c128e927 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:25.505495 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-735b295f-2805-4c9f-9dec-37e8c128e927 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:25.506079 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-735b295f-2805-4c9f-9dec-37e8c128e927 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:25.506941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-735b295f-2805-4c9f-9dec-37e8c128e927 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:25.507658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-735b295f-2805-4c9f-9dec-37e8c128e927 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:25.508226 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-735b295f-2805-4c9f-9dec-37e8c128e927 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:25.514819 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-43d8cd34-f0ec-4fd9-a2ec-d6e3a6d31219 req-7833066b-f02e-41cd-8a0c-39ed2876184c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "197dc2cf-12cf-4bf8-8dbd-c05654f127db", "tag": "319e5cdb-1d81-4b83-b357-3d505b372b72"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:25.534657 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-43d8cd34-f0ec-4fd9-a2ec-d6e3a6d31219 req-7833066b-f02e-41cd-8a0c-39ed2876184c service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:25.535439 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-43d8cd34-f0ec-4fd9-a2ec-d6e3a6d31219 req-7833066b-f02e-41cd-8a0c-39ed2876184c service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:25.536041 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-43d8cd34-f0ec-4fd9-a2ec-d6e3a6d31219 req-7833066b-f02e-41cd-8a0c-39ed2876184c service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:25.569423 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-43d8cd34-f0ec-4fd9-a2ec-d6e3a6d31219 req-7833066b-f02e-41cd-8a0c-39ed2876184c service nova] Creating event network-changed:319e5cdb-1d81-4b83-b357-3d505b372b72 for instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db on hv-cinder-85918 Sep 26 05:31:25.593880 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-43d8cd34-f0ec-4fd9-a2ec-d6e3a6d31219 req-7833066b-f02e-41cd-8a0c-39ed2876184c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082607 Sep 26 05:31:25.594475 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 159/304] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:31:25.714124 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-2be0c0ef-9f17-4897-8dd6-eea8fbe908ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:25.714857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-2be0c0ef-9f17-4897-8dd6-eea8fbe908ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:25.720966 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2be0c0ef-9f17-4897-8dd6-eea8fbe908ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:25.721453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-735b295f-2805-4c9f-9dec-37e8c128e927 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:25.721594 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2be0c0ef-9f17-4897-8dd6-eea8fbe908ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:25.721891 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2be0c0ef-9f17-4897-8dd6-eea8fbe908ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:25.723092 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2be0c0ef-9f17-4897-8dd6-eea8fbe908ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:25.723550 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2be0c0ef-9f17-4897-8dd6-eea8fbe908ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:25.723977 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2be0c0ef-9f17-4897-8dd6-eea8fbe908ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:25.730386 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-735b295f-2805-4c9f-9dec-37e8c128e927 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:25.731820 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-735b295f-2805-4c9f-9dec-37e8c128e927 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:25.733356 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-735b295f-2805-4c9f-9dec-37e8c128e927 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.242222 Sep 26 05:31:25.733909 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 146/305] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:25 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:25.859380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2be0c0ef-9f17-4897-8dd6-eea8fbe908ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:25.867355 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2be0c0ef-9f17-4897-8dd6-eea8fbe908ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1261 microversion: 2.1 time: 0.157449 Sep 26 05:31:25.868142 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 160/306] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:25 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:25.891423 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-33c842fe-8bc3-4c1d-b288-d0a76b420380 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:25.892346 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-33c842fe-8bc3-4c1d-b288-d0a76b420380 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:25.902970 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-33c842fe-8bc3-4c1d-b288-d0a76b420380 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:25.903453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-33c842fe-8bc3-4c1d-b288-d0a76b420380 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:25.903886 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-33c842fe-8bc3-4c1d-b288-d0a76b420380 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:25.904687 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-33c842fe-8bc3-4c1d-b288-d0a76b420380 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:25.905170 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-33c842fe-8bc3-4c1d-b288-d0a76b420380 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:25.905596 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-33c842fe-8bc3-4c1d-b288-d0a76b420380 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:26.036726 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-33c842fe-8bc3-4c1d-b288-d0a76b420380 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:26.044361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-33c842fe-8bc3-4c1d-b288-d0a76b420380 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.157342 Sep 26 05:31:26.044925 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 147/307] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:25 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:26.216221 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3b028258-5773-436c-abb6-b36b937bdb48 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:26.216976 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-3b028258-5773-436c-abb6-b36b937bdb48 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:26.223184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3b028258-5773-436c-abb6-b36b937bdb48 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:26.223809 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3b028258-5773-436c-abb6-b36b937bdb48 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:26.224534 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3b028258-5773-436c-abb6-b36b937bdb48 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:26.225399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3b028258-5773-436c-abb6-b36b937bdb48 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:26.225970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3b028258-5773-436c-abb6-b36b937bdb48 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:26.226470 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3b028258-5773-436c-abb6-b36b937bdb48 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:26.442117 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-3b028258-5773-436c-abb6-b36b937bdb48 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:26.450138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-3b028258-5773-436c-abb6-b36b937bdb48 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1368 microversion: 2.1 time: 0.237570 Sep 26 05:31:26.456454 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 161/308] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:26 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:26.759900 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-15171506-793b-4f90-b3a5-9fa8b9311f83 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:26.760464 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-15171506-793b-4f90-b3a5-9fa8b9311f83 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:26.767222 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15171506-793b-4f90-b3a5-9fa8b9311f83 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:26.767703 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15171506-793b-4f90-b3a5-9fa8b9311f83 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:26.768134 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15171506-793b-4f90-b3a5-9fa8b9311f83 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:26.768866 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15171506-793b-4f90-b3a5-9fa8b9311f83 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:26.769316 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15171506-793b-4f90-b3a5-9fa8b9311f83 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:26.769819 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15171506-793b-4f90-b3a5-9fa8b9311f83 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:26.890305 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-193257d2-8cf2-421f-bf36-4f33ee11bde2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:26.890910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-193257d2-8cf2-421f-bf36-4f33ee11bde2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:26.896849 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-193257d2-8cf2-421f-bf36-4f33ee11bde2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:26.897333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-193257d2-8cf2-421f-bf36-4f33ee11bde2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:26.897762 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-193257d2-8cf2-421f-bf36-4f33ee11bde2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:26.898445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-193257d2-8cf2-421f-bf36-4f33ee11bde2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:26.898887 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-193257d2-8cf2-421f-bf36-4f33ee11bde2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:26.899302 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-193257d2-8cf2-421f-bf36-4f33ee11bde2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:26.905536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-15171506-793b-4f90-b3a5-9fa8b9311f83 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:26.914522 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-15171506-793b-4f90-b3a5-9fa8b9311f83 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:26.915977 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-15171506-793b-4f90-b3a5-9fa8b9311f83 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:26.917158 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-15171506-793b-4f90-b3a5-9fa8b9311f83 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.161329 Sep 26 05:31:26.917736 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 148/309] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:26 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:27.028613 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-193257d2-8cf2-421f-bf36-4f33ee11bde2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:27.037696 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-193257d2-8cf2-421f-bf36-4f33ee11bde2 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1261 microversion: 2.1 time: 0.151081 Sep 26 05:31:27.038598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 162/310] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:26 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:27.067921 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5e6267e1-392c-4b45-b0f4-37ee990bc419 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:27.068623 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5e6267e1-392c-4b45-b0f4-37ee990bc419 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:27.075920 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e6267e1-392c-4b45-b0f4-37ee990bc419 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:27.076445 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e6267e1-392c-4b45-b0f4-37ee990bc419 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:27.076892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e6267e1-392c-4b45-b0f4-37ee990bc419 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:27.077590 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e6267e1-392c-4b45-b0f4-37ee990bc419 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:27.078049 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e6267e1-392c-4b45-b0f4-37ee990bc419 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:27.078478 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e6267e1-392c-4b45-b0f4-37ee990bc419 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:27.210137 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5e6267e1-392c-4b45-b0f4-37ee990bc419 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:27.212489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:27.219318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5e6267e1-392c-4b45-b0f4-37ee990bc419 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1501 microversion: 2.1 time: 0.156309 Sep 26 05:31:27.219882 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 149/311] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:27 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:27.243056 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3d6f0913-8983-4050-9754-396bcdfdba7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2c734ff-aac1-4883-b02f-2e6742cc0503"}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:27.245431 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-3d6f0913-8983-4050-9754-396bcdfdba7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:27.251570 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3d6f0913-8983-4050-9754-396bcdfdba7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:27.252092 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3d6f0913-8983-4050-9754-396bcdfdba7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:27.252624 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3d6f0913-8983-4050-9754-396bcdfdba7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:27.253533 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3d6f0913-8983-4050-9754-396bcdfdba7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:27.254142 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3d6f0913-8983-4050-9754-396bcdfdba7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:27.254587 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3d6f0913-8983-4050-9754-396bcdfdba7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:27.278772 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-3d6f0913-8983-4050-9754-396bcdfdba7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] HTTP exception thrown: Cannot 'attach_volume' instance 01274a67-17fb-45e3-9f2a-6a718b15b902 while it is in vm_state rescued Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3d6f0913-8983-4050-9754-396bcdfdba7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Request method failure captured: Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: POST /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902/os-volume_attachments HTTP/1.1 Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 74 Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTivBvtiLsDynVA2bAKI90oygZ30ioDR3YG_muA8Xt1hjZBfVOLnnIKeLoTKxZiO69-Ddx_DTOJh3FNG9fup9oSLVndq9WzArQ-VSQsJcXJKLTFn5mH1QcjR7BSlyztXNqEUpmqs3NzmftHVS2Zaxk0_x4Yll5AojazwDK2lCvQJ3as Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: 01c8f7766cb646b7b646a53c9de8e91a Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1282050550 Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:31:27.280437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:31:27.281967 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01c8f7766cb646b7b646a53c9de8e91a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01c8f7766cb646b7b646a53c9de8e91a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01c8f7766cb646b7b646a53c9de8e91a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01c8f7766cb646b7b646a53c9de8e91a"}]}] Sep 26 05:31:27.281967 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1282050550 Sep 26 05:31:27.281967 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: 01c8f7766cb646b7b646a53c9de8e91a Sep 26 05:31:27.281967 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1282050550 Sep 26 05:31:27.281967 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-ServerRescueNegativeTestJSON-1282050550-project Sep 26 05:31:27.281967 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:31:27.281967 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:31:27.281967 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 683c4d41fa4a452ba8210e62dd43f7f4 Sep 26 05:31:27.281967 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1282050550-project Sep 26 05:31:27.281967 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Sep 26 05:31:27.281967 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {"volumeAttachment": {"volumeId": "d2c734ff-aac1-4883-b02f-2e6742cc0503"}} Sep 26 05:31:27.281967 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Cannot 'attach_volume' instance 01274a67-17fb-45e3-9f2a-6a718b15b902 while it is in vm_state rescued Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'server_id': '01274a67-17fb-45e3-9f2a-6a718b15b902', 'body': {'volumeAttachment': {'volumeId': 'd2c734ff-aac1-4883-b02f-2e6742cc0503'}}} Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01274a67-17fb-45e3-9f2a-6a718b15b902 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:31:27.282801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 01274a67-17fb-45e3-9f2a-6a718b15b902 while it is in vm_state rescued Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:31:27.283970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:31:27.285732 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:31:27.285732 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:31:27.285732 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 01274a67-17fb-45e3-9f2a-6a718b15b902 while it is in vm_state rescued Sep 26 05:31:27.285732 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:31:27.285732 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3d6f0913-8983-4050-9754-396bcdfdba7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Returning 409 to user: Cannot 'attach_volume' instance 01274a67-17fb-45e3-9f2a-6a718b15b902 while it is in vm_state rescued {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:31:27.285732 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-3d6f0913-8983-4050-9754-396bcdfdba7d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "POST /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043075 Sep 26 05:31:27.285732 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 163/312] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 05:31:27 2022] POST /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 26 05:31:27.292626 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2e733622-7734-4369-8d6a-86df9302b681 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:27.293161 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2e733622-7734-4369-8d6a-86df9302b681 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:27.299241 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e733622-7734-4369-8d6a-86df9302b681 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:27.299729 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e733622-7734-4369-8d6a-86df9302b681 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:27.300206 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e733622-7734-4369-8d6a-86df9302b681 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:27.300931 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e733622-7734-4369-8d6a-86df9302b681 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:27.301383 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e733622-7734-4369-8d6a-86df9302b681 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:27.301802 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e733622-7734-4369-8d6a-86df9302b681 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:27.371683 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2e733622-7734-4369-8d6a-86df9302b681 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "POST /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902/action" status: 202 len: 0 microversion: 2.1 time: 0.082819 Sep 26 05:31:27.372578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 150/313] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 05:31:27 2022] POST /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:31:27.381037 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7681fc2b-92ed-45a4-9f84-89c66b1d07f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:27.381642 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7681fc2b-92ed-45a4-9f84-89c66b1d07f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:27.387533 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7681fc2b-92ed-45a4-9f84-89c66b1d07f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:27.388010 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7681fc2b-92ed-45a4-9f84-89c66b1d07f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:27.388487 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7681fc2b-92ed-45a4-9f84-89c66b1d07f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:27.389247 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7681fc2b-92ed-45a4-9f84-89c66b1d07f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:27.389946 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7681fc2b-92ed-45a4-9f84-89c66b1d07f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:27.390371 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7681fc2b-92ed-45a4-9f84-89c66b1d07f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:27.475221 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c6c4e38e-5c87-4222-8db9-91092a4db3b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:27.475927 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c6c4e38e-5c87-4222-8db9-91092a4db3b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:27.482398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c6c4e38e-5c87-4222-8db9-91092a4db3b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:27.483164 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c6c4e38e-5c87-4222-8db9-91092a4db3b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:27.483646 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c6c4e38e-5c87-4222-8db9-91092a4db3b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:27.484410 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c6c4e38e-5c87-4222-8db9-91092a4db3b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:27.484905 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c6c4e38e-5c87-4222-8db9-91092a4db3b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:27.485411 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c6c4e38e-5c87-4222-8db9-91092a4db3b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:27.522183 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7681fc2b-92ed-45a4-9f84-89c66b1d07f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:27.530708 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7681fc2b-92ed-45a4-9f84-89c66b1d07f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1509 microversion: 2.1 time: 0.153687 Sep 26 05:31:27.531494 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 164/314] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:27 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:27.620856 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c6c4e38e-5c87-4222-8db9-91092a4db3b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:27.628571 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c6c4e38e-5c87-4222-8db9-91092a4db3b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1368 microversion: 2.1 time: 0.157990 Sep 26 05:31:27.629131 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 151/315] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:27 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:27.945592 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-8d22e53e-9f9a-4fb1-8b56-dbb93426bed6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:27.946207 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-8d22e53e-9f9a-4fb1-8b56-dbb93426bed6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:27.952428 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8d22e53e-9f9a-4fb1-8b56-dbb93426bed6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:27.952911 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8d22e53e-9f9a-4fb1-8b56-dbb93426bed6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:27.953349 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8d22e53e-9f9a-4fb1-8b56-dbb93426bed6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:27.954040 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8d22e53e-9f9a-4fb1-8b56-dbb93426bed6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:27.954493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8d22e53e-9f9a-4fb1-8b56-dbb93426bed6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:27.954923 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8d22e53e-9f9a-4fb1-8b56-dbb93426bed6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:28.062521 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-22266c09-2b49-42ed-b9fe-1227c2824c45 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:28.063139 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-22266c09-2b49-42ed-b9fe-1227c2824c45 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:28.070287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22266c09-2b49-42ed-b9fe-1227c2824c45 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:28.070778 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22266c09-2b49-42ed-b9fe-1227c2824c45 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:28.071225 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22266c09-2b49-42ed-b9fe-1227c2824c45 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:28.071921 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22266c09-2b49-42ed-b9fe-1227c2824c45 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:28.072405 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22266c09-2b49-42ed-b9fe-1227c2824c45 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:28.072833 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22266c09-2b49-42ed-b9fe-1227c2824c45 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:28.093606 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8d22e53e-9f9a-4fb1-8b56-dbb93426bed6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:28.102119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8d22e53e-9f9a-4fb1-8b56-dbb93426bed6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:28.103574 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8d22e53e-9f9a-4fb1-8b56-dbb93426bed6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:28.104771 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-8d22e53e-9f9a-4fb1-8b56-dbb93426bed6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.163099 Sep 26 05:31:28.118735 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 165/316] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:27 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:28.204908 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-22266c09-2b49-42ed-b9fe-1227c2824c45 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:28.213839 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-22266c09-2b49-42ed-b9fe-1227c2824c45 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1261 microversion: 2.1 time: 0.154966 Sep 26 05:31:28.214418 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 152/317] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:28 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:28.555347 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a13590b3-ab5d-4774-8621-7dfb8b1afc04 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:28.555956 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a13590b3-ab5d-4774-8621-7dfb8b1afc04 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:28.561897 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a13590b3-ab5d-4774-8621-7dfb8b1afc04 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:28.562380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a13590b3-ab5d-4774-8621-7dfb8b1afc04 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:28.562821 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a13590b3-ab5d-4774-8621-7dfb8b1afc04 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:28.563501 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a13590b3-ab5d-4774-8621-7dfb8b1afc04 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:28.563952 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a13590b3-ab5d-4774-8621-7dfb8b1afc04 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:28.564403 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a13590b3-ab5d-4774-8621-7dfb8b1afc04 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:28.651012 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bdda0bbd-4137-4484-a7df-30dc1f5d5537 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:28.651620 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bdda0bbd-4137-4484-a7df-30dc1f5d5537 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:28.657705 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bdda0bbd-4137-4484-a7df-30dc1f5d5537 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:28.658194 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bdda0bbd-4137-4484-a7df-30dc1f5d5537 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:28.658631 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bdda0bbd-4137-4484-a7df-30dc1f5d5537 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:28.659343 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bdda0bbd-4137-4484-a7df-30dc1f5d5537 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:28.659807 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bdda0bbd-4137-4484-a7df-30dc1f5d5537 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:28.660229 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bdda0bbd-4137-4484-a7df-30dc1f5d5537 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:28.710974 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a13590b3-ab5d-4774-8621-7dfb8b1afc04 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:28.719020 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a13590b3-ab5d-4774-8621-7dfb8b1afc04 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1509 microversion: 2.1 time: 0.167480 Sep 26 05:31:28.719588 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 166/318] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:28 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:28.804445 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bdda0bbd-4137-4484-a7df-30dc1f5d5537 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:28.811945 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bdda0bbd-4137-4484-a7df-30dc1f5d5537 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1368 microversion: 2.1 time: 0.164733 Sep 26 05:31:28.812550 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 153/319] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:28 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:29.131605 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-fca680a7-39ce-46ca-bc4a-79109c3ff240 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:29.132212 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-fca680a7-39ce-46ca-bc4a-79109c3ff240 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:29.138074 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fca680a7-39ce-46ca-bc4a-79109c3ff240 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:29.138549 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fca680a7-39ce-46ca-bc4a-79109c3ff240 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:29.138977 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fca680a7-39ce-46ca-bc4a-79109c3ff240 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:29.139648 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fca680a7-39ce-46ca-bc4a-79109c3ff240 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:29.140093 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fca680a7-39ce-46ca-bc4a-79109c3ff240 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:29.140537 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fca680a7-39ce-46ca-bc4a-79109c3ff240 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:29.237517 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-81a5d51c-b93a-427d-bd31-e7dd37312c0a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:29.238346 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-81a5d51c-b93a-427d-bd31-e7dd37312c0a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:29.245206 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81a5d51c-b93a-427d-bd31-e7dd37312c0a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:29.245724 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81a5d51c-b93a-427d-bd31-e7dd37312c0a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:29.246159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81a5d51c-b93a-427d-bd31-e7dd37312c0a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:29.246854 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81a5d51c-b93a-427d-bd31-e7dd37312c0a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:29.247308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81a5d51c-b93a-427d-bd31-e7dd37312c0a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:29.247735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81a5d51c-b93a-427d-bd31-e7dd37312c0a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:29.272032 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-fca680a7-39ce-46ca-bc4a-79109c3ff240 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:29.282424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-fca680a7-39ce-46ca-bc4a-79109c3ff240 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:29.283913 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-fca680a7-39ce-46ca-bc4a-79109c3ff240 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:29.285532 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-fca680a7-39ce-46ca-bc4a-79109c3ff240 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.158250 Sep 26 05:31:29.286095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 167/320] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:29 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:29.381758 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-81a5d51c-b93a-427d-bd31-e7dd37312c0a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:29.389483 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-81a5d51c-b93a-427d-bd31-e7dd37312c0a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1261 microversion: 2.1 time: 0.155825 Sep 26 05:31:29.390046 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 154/321] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:29 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:29.743250 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-64b05a8c-567f-4ec8-b2e7-bea16fa53d1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:29.744531 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-64b05a8c-567f-4ec8-b2e7-bea16fa53d1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:29.751532 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-64b05a8c-567f-4ec8-b2e7-bea16fa53d1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:29.752398 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-64b05a8c-567f-4ec8-b2e7-bea16fa53d1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:29.753814 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-64b05a8c-567f-4ec8-b2e7-bea16fa53d1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:29.754925 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-64b05a8c-567f-4ec8-b2e7-bea16fa53d1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:29.755609 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-64b05a8c-567f-4ec8-b2e7-bea16fa53d1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:29.756470 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-64b05a8c-567f-4ec8-b2e7-bea16fa53d1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:29.777466 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=100 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:29.838847 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c0718e5a-0057-460e-a93d-74b2198b2811 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:29.838847 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c0718e5a-0057-460e-a93d-74b2198b2811 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:29.843574 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c0718e5a-0057-460e-a93d-74b2198b2811 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:29.844070 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c0718e5a-0057-460e-a93d-74b2198b2811 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:29.844542 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c0718e5a-0057-460e-a93d-74b2198b2811 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:29.845250 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c0718e5a-0057-460e-a93d-74b2198b2811 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:29.845708 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c0718e5a-0057-460e-a93d-74b2198b2811 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:29.846153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c0718e5a-0057-460e-a93d-74b2198b2811 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:30.016280 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-64b05a8c-567f-4ec8-b2e7-bea16fa53d1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:30.025020 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-64b05a8c-567f-4ec8-b2e7-bea16fa53d1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1509 microversion: 2.1 time: 0.285682 Sep 26 05:31:30.025830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 168/322] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:29 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1509 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:30.094362 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c0718e5a-0057-460e-a93d-74b2198b2811 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:30.102534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c0718e5a-0057-460e-a93d-74b2198b2811 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1368 microversion: 2.1 time: 0.271088 Sep 26 05:31:30.103208 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 155/323] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:29 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1368 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:30.310835 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a4d72c29-a224-4f85-989a-53086a66c070 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:30.311742 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a4d72c29-a224-4f85-989a-53086a66c070 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:30.313745 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=4 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:30.314414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=12 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:30.321100 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4d72c29-a224-4f85-989a-53086a66c070 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:30.321758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4d72c29-a224-4f85-989a-53086a66c070 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:30.322201 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4d72c29-a224-4f85-989a-53086a66c070 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:30.322910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4d72c29-a224-4f85-989a-53086a66c070 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:30.323365 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4d72c29-a224-4f85-989a-53086a66c070 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:30.323791 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4d72c29-a224-4f85-989a-53086a66c070 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:30.412630 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e6765a8d-fdb5-49af-acb8-497b13797e6e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:30.413277 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e6765a8d-fdb5-49af-acb8-497b13797e6e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:30.415717 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=8 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:30.421590 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e6765a8d-fdb5-49af-acb8-497b13797e6e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:30.422080 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e6765a8d-fdb5-49af-acb8-497b13797e6e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:30.422514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e6765a8d-fdb5-49af-acb8-497b13797e6e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:30.423208 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e6765a8d-fdb5-49af-acb8-497b13797e6e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:30.423659 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e6765a8d-fdb5-49af-acb8-497b13797e6e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:30.424111 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e6765a8d-fdb5-49af-acb8-497b13797e6e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:30.639693 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e6765a8d-fdb5-49af-acb8-497b13797e6e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:30.651000 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e6765a8d-fdb5-49af-acb8-497b13797e6e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1261 microversion: 2.1 time: 0.242434 Sep 26 05:31:30.651777 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 156/324] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:30 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1261 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:30.652387 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a4d72c29-a224-4f85-989a-53086a66c070 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:30.661933 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a4d72c29-a224-4f85-989a-53086a66c070 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:30.663431 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a4d72c29-a224-4f85-989a-53086a66c070 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:30.664620 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a4d72c29-a224-4f85-989a-53086a66c070 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.357746 Sep 26 05:31:30.665172 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 169/325] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:30 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:31.048527 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ae3a6de0-ccd6-4614-b31c-76cc7e1753a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:31.049137 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ae3a6de0-ccd6-4614-b31c-76cc7e1753a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:31.055744 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ae3a6de0-ccd6-4614-b31c-76cc7e1753a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:31.056229 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ae3a6de0-ccd6-4614-b31c-76cc7e1753a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:31.056692 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ae3a6de0-ccd6-4614-b31c-76cc7e1753a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:31.057377 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ae3a6de0-ccd6-4614-b31c-76cc7e1753a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:31.057848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ae3a6de0-ccd6-4614-b31c-76cc7e1753a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:31.058312 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ae3a6de0-ccd6-4614-b31c-76cc7e1753a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:31.126829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f872dfef-109f-4199-8ec9-ef0b7d6b0350 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:31.127445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f872dfef-109f-4199-8ec9-ef0b7d6b0350 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:31.134960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f872dfef-109f-4199-8ec9-ef0b7d6b0350 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:31.135447 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f872dfef-109f-4199-8ec9-ef0b7d6b0350 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:31.136002 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f872dfef-109f-4199-8ec9-ef0b7d6b0350 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:31.136583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f872dfef-109f-4199-8ec9-ef0b7d6b0350 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:31.137041 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f872dfef-109f-4199-8ec9-ef0b7d6b0350 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:31.137466 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f872dfef-109f-4199-8ec9-ef0b7d6b0350 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:31.212728 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ae3a6de0-ccd6-4614-b31c-76cc7e1753a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:31.220515 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ae3a6de0-ccd6-4614-b31c-76cc7e1753a9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1509 microversion: 2.1 time: 0.175839 Sep 26 05:31:31.221285 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 157/326] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:31 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:31.279544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f872dfef-109f-4199-8ec9-ef0b7d6b0350 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:31.288438 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f872dfef-109f-4199-8ec9-ef0b7d6b0350 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1368 microversion: 2.1 time: 0.165425 Sep 26 05:31:31.289009 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 170/327] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:31 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:31.674443 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c680d0ef-b28b-4e8f-b17c-dc9865e4e8a8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:31.675006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c680d0ef-b28b-4e8f-b17c-dc9865e4e8a8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:31.682463 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c680d0ef-b28b-4e8f-b17c-dc9865e4e8a8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:31.682945 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c680d0ef-b28b-4e8f-b17c-dc9865e4e8a8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:31.683368 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c680d0ef-b28b-4e8f-b17c-dc9865e4e8a8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:31.684051 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c680d0ef-b28b-4e8f-b17c-dc9865e4e8a8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:31.684523 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c680d0ef-b28b-4e8f-b17c-dc9865e4e8a8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:31.684939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c680d0ef-b28b-4e8f-b17c-dc9865e4e8a8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:31.690970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-351c497f-91e8-4a16-a48d-239119cf4877 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:31.692198 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-351c497f-91e8-4a16-a48d-239119cf4877 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:31.698095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-351c497f-91e8-4a16-a48d-239119cf4877 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:31.698575 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-351c497f-91e8-4a16-a48d-239119cf4877 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:31.699011 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-351c497f-91e8-4a16-a48d-239119cf4877 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:31.699689 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-351c497f-91e8-4a16-a48d-239119cf4877 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:31.700134 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-351c497f-91e8-4a16-a48d-239119cf4877 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:31.700711 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-351c497f-91e8-4a16-a48d-239119cf4877 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:31.893647 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c680d0ef-b28b-4e8f-b17c-dc9865e4e8a8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:31.896995 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-351c497f-91e8-4a16-a48d-239119cf4877 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:31.902945 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c680d0ef-b28b-4e8f-b17c-dc9865e4e8a8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1261 microversion: 2.1 time: 0.232340 Sep 26 05:31:31.903659 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 158/328] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:31 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1261 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:31.905820 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-351c497f-91e8-4a16-a48d-239119cf4877 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:31.907270 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-351c497f-91e8-4a16-a48d-239119cf4877 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:31.908500 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-351c497f-91e8-4a16-a48d-239119cf4877 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.222939 Sep 26 05:31:31.909276 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 171/329] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:31 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:31:32.245087 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fe0c7400-e935-42f3-9c78-6006008e4f6f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:32.245738 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fe0c7400-e935-42f3-9c78-6006008e4f6f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:32.252562 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe0c7400-e935-42f3-9c78-6006008e4f6f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:32.253195 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe0c7400-e935-42f3-9c78-6006008e4f6f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:32.253749 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe0c7400-e935-42f3-9c78-6006008e4f6f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:32.254549 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe0c7400-e935-42f3-9c78-6006008e4f6f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:32.255125 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe0c7400-e935-42f3-9c78-6006008e4f6f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:32.255612 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe0c7400-e935-42f3-9c78-6006008e4f6f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:32.312607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1f1ba0ef-a915-48ec-a697-1d9dc0ea109a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:32.314350 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-1f1ba0ef-a915-48ec-a697-1d9dc0ea109a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:32.320932 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f1ba0ef-a915-48ec-a697-1d9dc0ea109a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:32.321498 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f1ba0ef-a915-48ec-a697-1d9dc0ea109a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:32.322023 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f1ba0ef-a915-48ec-a697-1d9dc0ea109a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:32.322721 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f1ba0ef-a915-48ec-a697-1d9dc0ea109a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:32.323174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f1ba0ef-a915-48ec-a697-1d9dc0ea109a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:32.324654 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f1ba0ef-a915-48ec-a697-1d9dc0ea109a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:32.418089 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fe0c7400-e935-42f3-9c78-6006008e4f6f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:32.426578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fe0c7400-e935-42f3-9c78-6006008e4f6f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1509 microversion: 2.1 time: 0.185805 Sep 26 05:31:32.427139 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 159/330] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:32 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:32.479468 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1f1ba0ef-a915-48ec-a697-1d9dc0ea109a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:32.489179 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1f1ba0ef-a915-48ec-a697-1d9dc0ea109a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1368 microversion: 2.1 time: 0.181551 Sep 26 05:31:32.489740 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 172/331] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:32 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:32.926266 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fb96df03-4d9c-4791-853b-1b3c9f4398ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:32.926875 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fb96df03-4d9c-4791-853b-1b3c9f4398ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:32.933512 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fb96df03-4d9c-4791-853b-1b3c9f4398ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:32.934027 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fb96df03-4d9c-4791-853b-1b3c9f4398ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:32.934437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-964f7544-a627-4296-83a1-abf5aa019e4f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:32.934564 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fb96df03-4d9c-4791-853b-1b3c9f4398ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:32.935072 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-964f7544-a627-4296-83a1-abf5aa019e4f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:32.935179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fb96df03-4d9c-4791-853b-1b3c9f4398ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:32.935640 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fb96df03-4d9c-4791-853b-1b3c9f4398ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:32.936107 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fb96df03-4d9c-4791-853b-1b3c9f4398ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:32.941538 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-964f7544-a627-4296-83a1-abf5aa019e4f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:32.942016 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-964f7544-a627-4296-83a1-abf5aa019e4f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:32.942450 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-964f7544-a627-4296-83a1-abf5aa019e4f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:32.943140 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-964f7544-a627-4296-83a1-abf5aa019e4f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:32.943593 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-964f7544-a627-4296-83a1-abf5aa019e4f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:32.944016 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-964f7544-a627-4296-83a1-abf5aa019e4f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:33.128735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fb96df03-4d9c-4791-853b-1b3c9f4398ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:33.135255 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-964f7544-a627-4296-83a1-abf5aa019e4f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:33.136768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fb96df03-4d9c-4791-853b-1b3c9f4398ce tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1261 microversion: 2.1 time: 0.214384 Sep 26 05:31:33.137343 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 160/332] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:32 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1261 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:33.143332 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-964f7544-a627-4296-83a1-abf5aa019e4f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:33.145543 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-964f7544-a627-4296-83a1-abf5aa019e4f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:33.146693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-964f7544-a627-4296-83a1-abf5aa019e4f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.216103 Sep 26 05:31:33.147230 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 173/333] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:32 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:31:33.318713 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-8a54dc21-e607-4f56-849e-cddbad4a6331 req-02787535-3f3f-4879-b2c0-31a3b1a28b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "197dc2cf-12cf-4bf8-8dbd-c05654f127db", "name": "network-vif-plugged", "status": "completed", "tag": "319e5cdb-1d81-4b83-b357-3d505b372b72"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:33.329612 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-8a54dc21-e607-4f56-849e-cddbad4a6331 req-02787535-3f3f-4879-b2c0-31a3b1a28b15 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:33.330094 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-8a54dc21-e607-4f56-849e-cddbad4a6331 req-02787535-3f3f-4879-b2c0-31a3b1a28b15 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:33.330522 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-8a54dc21-e607-4f56-849e-cddbad4a6331 req-02787535-3f3f-4879-b2c0-31a3b1a28b15 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:33.341786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-8a54dc21-e607-4f56-849e-cddbad4a6331 req-02787535-3f3f-4879-b2c0-31a3b1a28b15 service nova] Creating event network-vif-plugged:319e5cdb-1d81-4b83-b357-3d505b372b72 for instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db on hv-cinder-85918 Sep 26 05:31:33.346546 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-8a54dc21-e607-4f56-849e-cddbad4a6331 req-02787535-3f3f-4879-b2c0-31a3b1a28b15 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032792 Sep 26 05:31:33.347580 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 161/334] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:31:33.449388 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5bc11f4e-ff25-4009-b8df-d5024c595cc8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:33.450017 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5bc11f4e-ff25-4009-b8df-d5024c595cc8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:33.455920 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5bc11f4e-ff25-4009-b8df-d5024c595cc8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:33.456558 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5bc11f4e-ff25-4009-b8df-d5024c595cc8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:33.457135 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5bc11f4e-ff25-4009-b8df-d5024c595cc8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:33.457866 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5bc11f4e-ff25-4009-b8df-d5024c595cc8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:33.458335 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5bc11f4e-ff25-4009-b8df-d5024c595cc8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:33.458772 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5bc11f4e-ff25-4009-b8df-d5024c595cc8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:33.512329 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c4cb3ebc-e6c2-4bc9-babf-d8221a89ff15 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:33.513087 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c4cb3ebc-e6c2-4bc9-babf-d8221a89ff15 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:33.519964 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4cb3ebc-e6c2-4bc9-babf-d8221a89ff15 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:33.520489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4cb3ebc-e6c2-4bc9-babf-d8221a89ff15 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:33.520930 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4cb3ebc-e6c2-4bc9-babf-d8221a89ff15 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:33.521624 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4cb3ebc-e6c2-4bc9-babf-d8221a89ff15 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:33.522078 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4cb3ebc-e6c2-4bc9-babf-d8221a89ff15 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:33.522508 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4cb3ebc-e6c2-4bc9-babf-d8221a89ff15 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:33.637889 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5bc11f4e-ff25-4009-b8df-d5024c595cc8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:33.646260 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5bc11f4e-ff25-4009-b8df-d5024c595cc8 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1509 microversion: 2.1 time: 0.200722 Sep 26 05:31:33.647029 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 174/335] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:33 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:33.686975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c4cb3ebc-e6c2-4bc9-babf-d8221a89ff15 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:33.695563 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c4cb3ebc-e6c2-4bc9-babf-d8221a89ff15 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1368 microversion: 2.1 time: 0.187474 Sep 26 05:31:33.696287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 162/336] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:33 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:34.160740 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-985a546e-77e6-4ef1-8d90-0ff5e31cf535 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:34.161291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-985a546e-77e6-4ef1-8d90-0ff5e31cf535 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:34.167204 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-985a546e-77e6-4ef1-8d90-0ff5e31cf535 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:34.167687 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-985a546e-77e6-4ef1-8d90-0ff5e31cf535 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:34.168121 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-985a546e-77e6-4ef1-8d90-0ff5e31cf535 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:34.168830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-985a546e-77e6-4ef1-8d90-0ff5e31cf535 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:34.169282 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-985a546e-77e6-4ef1-8d90-0ff5e31cf535 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:34.169770 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-985a546e-77e6-4ef1-8d90-0ff5e31cf535 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:34.172615 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-85b78959-1da3-43d6-b04c-f586bc5e4c01 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:34.173226 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-85b78959-1da3-43d6-b04c-f586bc5e4c01 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:34.179325 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-85b78959-1da3-43d6-b04c-f586bc5e4c01 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:34.179806 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-85b78959-1da3-43d6-b04c-f586bc5e4c01 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:34.180241 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-85b78959-1da3-43d6-b04c-f586bc5e4c01 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:34.181131 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-85b78959-1da3-43d6-b04c-f586bc5e4c01 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:34.181452 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-85b78959-1da3-43d6-b04c-f586bc5e4c01 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:34.181865 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-85b78959-1da3-43d6-b04c-f586bc5e4c01 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:34.385821 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-985a546e-77e6-4ef1-8d90-0ff5e31cf535 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:34.394882 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-985a546e-77e6-4ef1-8d90-0ff5e31cf535 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1261 microversion: 2.1 time: 0.238352 Sep 26 05:31:34.395760 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 175/337] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:34 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1261 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:34.398702 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-85b78959-1da3-43d6-b04c-f586bc5e4c01 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:34.406982 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-85b78959-1da3-43d6-b04c-f586bc5e4c01 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:34.408544 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-85b78959-1da3-43d6-b04c-f586bc5e4c01 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:34.410515 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-85b78959-1da3-43d6-b04c-f586bc5e4c01 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1744 microversion: 2.20 time: 0.241767 Sep 26 05:31:34.411258 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 163/338] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:34 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1744 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:31:34.671053 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-742d0b74-d5af-473b-bf99-ac30d200f543 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:34.671570 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-742d0b74-d5af-473b-bf99-ac30d200f543 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:34.677585 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-742d0b74-d5af-473b-bf99-ac30d200f543 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:34.678070 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-742d0b74-d5af-473b-bf99-ac30d200f543 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:34.678504 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-742d0b74-d5af-473b-bf99-ac30d200f543 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:34.679188 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-742d0b74-d5af-473b-bf99-ac30d200f543 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:34.679641 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-742d0b74-d5af-473b-bf99-ac30d200f543 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:34.680062 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-742d0b74-d5af-473b-bf99-ac30d200f543 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:34.717561 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1b854263-39f9-4f2a-a20d-c2ece2744e5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:34.719008 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1b854263-39f9-4f2a-a20d-c2ece2744e5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:34.722517 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:34.726632 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1b854263-39f9-4f2a-a20d-c2ece2744e5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:34.727123 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1b854263-39f9-4f2a-a20d-c2ece2744e5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:34.727553 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1b854263-39f9-4f2a-a20d-c2ece2744e5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:34.728301 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1b854263-39f9-4f2a-a20d-c2ece2744e5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:34.728715 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1b854263-39f9-4f2a-a20d-c2ece2744e5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:34.729131 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1b854263-39f9-4f2a-a20d-c2ece2744e5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:34.859724 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-742d0b74-d5af-473b-bf99-ac30d200f543 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:34.868349 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-742d0b74-d5af-473b-bf99-ac30d200f543 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1515 microversion: 2.1 time: 0.201214 Sep 26 05:31:34.869005 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 176/339] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:34 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1515 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:34.895175 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1b854263-39f9-4f2a-a20d-c2ece2744e5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:34.903263 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1b854263-39f9-4f2a-a20d-c2ece2744e5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1368 microversion: 2.1 time: 0.189417 Sep 26 05:31:34.904026 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 164/340] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:34 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:35.418829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d845cf4c-3425-471d-b5f8-7cf5da9b01c3 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:35.419460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d845cf4c-3425-471d-b5f8-7cf5da9b01c3 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:35.426443 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d845cf4c-3425-471d-b5f8-7cf5da9b01c3 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:35.426929 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d845cf4c-3425-471d-b5f8-7cf5da9b01c3 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:35.427367 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d845cf4c-3425-471d-b5f8-7cf5da9b01c3 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:35.428055 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d845cf4c-3425-471d-b5f8-7cf5da9b01c3 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:35.428539 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d845cf4c-3425-471d-b5f8-7cf5da9b01c3 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:35.428963 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d845cf4c-3425-471d-b5f8-7cf5da9b01c3 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:35.436058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d0dd96d5-546f-4070-9147-5bfc956802cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:35.436779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d0dd96d5-546f-4070-9147-5bfc956802cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:35.443456 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0dd96d5-546f-4070-9147-5bfc956802cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:35.443937 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0dd96d5-546f-4070-9147-5bfc956802cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:35.444395 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0dd96d5-546f-4070-9147-5bfc956802cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:35.445074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0dd96d5-546f-4070-9147-5bfc956802cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:35.445520 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0dd96d5-546f-4070-9147-5bfc956802cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:35.445935 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0dd96d5-546f-4070-9147-5bfc956802cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:35.631974 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d845cf4c-3425-471d-b5f8-7cf5da9b01c3 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:35.635975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d0dd96d5-546f-4070-9147-5bfc956802cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:35.640302 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d845cf4c-3425-471d-b5f8-7cf5da9b01c3 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1261 microversion: 2.1 time: 0.225209 Sep 26 05:31:35.641079 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 177/341] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:35 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1261 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:35.645272 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d0dd96d5-546f-4070-9147-5bfc956802cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:35.646755 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d0dd96d5-546f-4070-9147-5bfc956802cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:35.647920 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d0dd96d5-546f-4070-9147-5bfc956802cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1744 microversion: 2.20 time: 0.215680 Sep 26 05:31:35.648652 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 165/342] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:35 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1744 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:31:35.926793 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f662b889-4bd1-4430-8502-e6ec4d2961eb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:35.927405 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f662b889-4bd1-4430-8502-e6ec4d2961eb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:35.933336 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f662b889-4bd1-4430-8502-e6ec4d2961eb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:35.933806 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f662b889-4bd1-4430-8502-e6ec4d2961eb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:35.934232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f662b889-4bd1-4430-8502-e6ec4d2961eb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:35.934904 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f662b889-4bd1-4430-8502-e6ec4d2961eb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:35.935348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f662b889-4bd1-4430-8502-e6ec4d2961eb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:35.935769 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f662b889-4bd1-4430-8502-e6ec4d2961eb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:36.063769 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f662b889-4bd1-4430-8502-e6ec4d2961eb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:36.072065 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f662b889-4bd1-4430-8502-e6ec4d2961eb tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1368 microversion: 2.1 time: 0.149356 Sep 26 05:31:36.072649 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 178/343] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:35 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:36.239168 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0c33f1e5-7c7e-43cf-8e27-861b7cab4ba2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Action: 'create', calling method: .version_select at 0x7fd7b76aa8b0>, body: {"keypair": {"name": "tempest-keypair-1084361819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvhKei5Pd6giDOlRv6mZ7SI4rSdbCmz5lyH6qmOFTcD8BO9VYFRzIyKEiTga6IbHbSIdDDwxd2+iU2ZA1EoWbrL3D6dlUZG9Ugwh2ck6UheZ3nSTwfFPD0McR99L16+6A=="}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:36.254940 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-0c33f1e5-7c7e-43cf-8e27-861b7cab4ba2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Getting quotas for project 01c8f7766cb646b7b646a53c9de8e91a. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:31:36.258745 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-0c33f1e5-7c7e-43cf-8e27-861b7cab4ba2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Getting quotas for user 683c4d41fa4a452ba8210e62dd43f7f4 and project 01c8f7766cb646b7b646a53c9de8e91a. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:31:36.280707 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0c33f1e5-7c7e-43cf-8e27-861b7cab4ba2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045543 Sep 26 05:31:36.281489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 166/344] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 05:31:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:31:36.664596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c4f3da52-0a04-4b2e-841a-ff0c5d253cfd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:36.665297 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c4f3da52-0a04-4b2e-841a-ff0c5d253cfd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:36.668794 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:36.672607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c4f3da52-0a04-4b2e-841a-ff0c5d253cfd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:36.673096 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c4f3da52-0a04-4b2e-841a-ff0c5d253cfd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:36.673921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c4f3da52-0a04-4b2e-841a-ff0c5d253cfd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:36.675525 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-aa7ac9a4-3bbe-4d89-bf7f-a7c4ad437adc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:36.676164 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-aa7ac9a4-3bbe-4d89-bf7f-a7c4ad437adc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:36.676457 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c4f3da52-0a04-4b2e-841a-ff0c5d253cfd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:36.677081 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c4f3da52-0a04-4b2e-841a-ff0c5d253cfd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:36.682750 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aa7ac9a4-3bbe-4d89-bf7f-a7c4ad437adc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:36.683240 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aa7ac9a4-3bbe-4d89-bf7f-a7c4ad437adc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:36.683672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aa7ac9a4-3bbe-4d89-bf7f-a7c4ad437adc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:36.684550 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aa7ac9a4-3bbe-4d89-bf7f-a7c4ad437adc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:36.685150 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aa7ac9a4-3bbe-4d89-bf7f-a7c4ad437adc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:36.685723 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aa7ac9a4-3bbe-4d89-bf7f-a7c4ad437adc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:36.688654 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c4f3da52-0a04-4b2e-841a-ff0c5d253cfd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:36.710935 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:36.897911 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-aa7ac9a4-3bbe-4d89-bf7f-a7c4ad437adc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:36.904442 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-c4f3da52-0a04-4b2e-841a-ff0c5d253cfd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:36.907436 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-aa7ac9a4-3bbe-4d89-bf7f-a7c4ad437adc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:36.909961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-aa7ac9a4-3bbe-4d89-bf7f-a7c4ad437adc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:36.911451 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-aa7ac9a4-3bbe-4d89-bf7f-a7c4ad437adc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1744 microversion: 2.20 time: 0.241331 Sep 26 05:31:36.912315 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 167/345] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:36 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1744 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:31:36.913840 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c4f3da52-0a04-4b2e-841a-ff0c5d253cfd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1261 microversion: 2.1 time: 0.253424 Sep 26 05:31:36.914399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 179/346] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:36 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1261 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:37.095303 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-15356e95-7dfe-4fa3-95f3-e7c1369702ff tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:37.096000 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-15356e95-7dfe-4fa3-95f3-e7c1369702ff tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:37.102630 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15356e95-7dfe-4fa3-95f3-e7c1369702ff tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:37.103192 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15356e95-7dfe-4fa3-95f3-e7c1369702ff tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:37.103747 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15356e95-7dfe-4fa3-95f3-e7c1369702ff tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:37.104703 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15356e95-7dfe-4fa3-95f3-e7c1369702ff tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:37.105272 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15356e95-7dfe-4fa3-95f3-e7c1369702ff tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:37.105776 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15356e95-7dfe-4fa3-95f3-e7c1369702ff tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:37.248231 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-15356e95-7dfe-4fa3-95f3-e7c1369702ff tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:37.257258 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-15356e95-7dfe-4fa3-95f3-e7c1369702ff tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1368 microversion: 2.1 time: 0.165827 Sep 26 05:31:37.257833 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 168/347] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:37 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:37.491310 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-8383373d-62e8-4619-b248-857b9255b6c6 req-2b99f7b6-d9bb-4caf-92fc-14924cfc9a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffa337e-39e1-4edc-9a0d-4468ff05c577", "name": "network-vif-plugged", "status": "completed", "tag": "db14dfec-952b-46e2-9617-72801c005bb3"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:37.504058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-8383373d-62e8-4619-b248-857b9255b6c6 req-2b99f7b6-d9bb-4caf-92fc-14924cfc9a28 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:37.504798 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-8383373d-62e8-4619-b248-857b9255b6c6 req-2b99f7b6-d9bb-4caf-92fc-14924cfc9a28 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:37.506005 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-8383373d-62e8-4619-b248-857b9255b6c6 req-2b99f7b6-d9bb-4caf-92fc-14924cfc9a28 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:37.522560 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-8383373d-62e8-4619-b248-857b9255b6c6 req-2b99f7b6-d9bb-4caf-92fc-14924cfc9a28 service nova] Creating event network-vif-plugged:db14dfec-952b-46e2-9617-72801c005bb3 for instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 on hv-cinder-85918 Sep 26 05:31:37.528759 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-8383373d-62e8-4619-b248-857b9255b6c6 req-2b99f7b6-d9bb-4caf-92fc-14924cfc9a28 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041799 Sep 26 05:31:37.529536 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 180/348] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:31:37.614326 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f7fd0994-46aa-4058-8008-2afee7f13560 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1450090931", "imageRef": "d37a4f3d-6311-48af-9e33-4c62c14cdd1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a42108c-0615-4b7d-80da-4c23f250e4d0"}], "security_groups": [{"name": "tempest-securitygroup--1446927348"}], "key_name": "tempest-keypair-1084361819", "user_data": "}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:37.719627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-f7fd0994-46aa-4058-8008-2afee7f13560 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] validate_networks() for [('7a42108c-0615-4b7d-80da-4c23f250e4d0', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:31:37.942292 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-85f21cbf-af95-4734-b191-17525ccde810 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:37.942920 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-85f21cbf-af95-4734-b191-17525ccde810 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:37.949016 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-85f21cbf-af95-4734-b191-17525ccde810 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:37.949497 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-85f21cbf-af95-4734-b191-17525ccde810 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:37.949929 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-85f21cbf-af95-4734-b191-17525ccde810 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:37.950613 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-85f21cbf-af95-4734-b191-17525ccde810 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:37.951060 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-85f21cbf-af95-4734-b191-17525ccde810 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:37.951498 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-85f21cbf-af95-4734-b191-17525ccde810 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:38.172583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-85f21cbf-af95-4734-b191-17525ccde810 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:38.179507 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-f7fd0994-46aa-4058-8008-2afee7f13560 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:31:38.179924 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-f7fd0994-46aa-4058-8008-2afee7f13560 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:31:38.180424 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-f7fd0994-46aa-4058-8008-2afee7f13560 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:31:38.180984 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-f7fd0994-46aa-4058-8008-2afee7f13560 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:31:38.181560 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-f7fd0994-46aa-4058-8008-2afee7f13560 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:31:38.181975 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-85f21cbf-af95-4734-b191-17525ccde810 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:38.183491 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-85f21cbf-af95-4734-b191-17525ccde810 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:38.184754 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-85f21cbf-af95-4734-b191-17525ccde810 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1744 microversion: 2.20 time: 0.249297 Sep 26 05:31:38.185379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 181/349] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:37 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1744 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:31:38.189892 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-47994b9c-3f1b-4536-8ceb-0fd522b377ef tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:38.190604 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-47994b9c-3f1b-4536-8ceb-0fd522b377ef tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:38.192705 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7fd0994-46aa-4058-8008-2afee7f13560 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:38.193204 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7fd0994-46aa-4058-8008-2afee7f13560 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:38.193825 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7fd0994-46aa-4058-8008-2afee7f13560 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:38.194894 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7fd0994-46aa-4058-8008-2afee7f13560 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:38.195532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7fd0994-46aa-4058-8008-2afee7f13560 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:38.196106 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7fd0994-46aa-4058-8008-2afee7f13560 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:38.196711 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-47994b9c-3f1b-4536-8ceb-0fd522b377ef tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:38.197260 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-47994b9c-3f1b-4536-8ceb-0fd522b377ef tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:38.197772 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-47994b9c-3f1b-4536-8ceb-0fd522b377ef tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:38.198517 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-47994b9c-3f1b-4536-8ceb-0fd522b377ef tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:38.199032 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-47994b9c-3f1b-4536-8ceb-0fd522b377ef tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:38.199521 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-47994b9c-3f1b-4536-8ceb-0fd522b377ef tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:38.213189 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-f7fd0994-46aa-4058-8008-2afee7f13560 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Getting quotas for project 01c8f7766cb646b7b646a53c9de8e91a. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:31:38.218678 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-f7fd0994-46aa-4058-8008-2afee7f13560 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Getting quotas for user 683c4d41fa4a452ba8210e62dd43f7f4 and project 01c8f7766cb646b7b646a53c9de8e91a. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:31:38.230306 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f7fd0994-46aa-4058-8008-2afee7f13560 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:31:38.232881 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f7fd0994-46aa-4058-8008-2afee7f13560 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d37a4f3d-6311-48af-9e33-4c62c14cdd1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:31:38.285015 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f7fd0994-46aa-4058-8008-2afee7f13560 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.674968 Sep 26 05:31:38.291606 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 169/350] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:31:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:31:38.291606 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2d3f14ce-b7ad-488b-a6c1-c8e75b34de50 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "063fd65b-f5ce-408e-b392-b992ee4aa112", "device": "/dev/sdb"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:38.293232 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2d3f14ce-b7ad-488b-a6c1-c8e75b34de50 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:38.300650 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d3f14ce-b7ad-488b-a6c1-c8e75b34de50 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:38.301287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d3f14ce-b7ad-488b-a6c1-c8e75b34de50 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:38.301718 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d3f14ce-b7ad-488b-a6c1-c8e75b34de50 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:38.302402 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d3f14ce-b7ad-488b-a6c1-c8e75b34de50 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:38.302994 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d3f14ce-b7ad-488b-a6c1-c8e75b34de50 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:38.303422 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d3f14ce-b7ad-488b-a6c1-c8e75b34de50 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:38.343421 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-47994b9c-3f1b-4536-8ceb-0fd522b377ef tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:38.351831 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-47994b9c-3f1b-4536-8ceb-0fd522b377ef tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1261 microversion: 2.1 time: 0.165394 Sep 26 05:31:38.352846 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 182/351] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:38 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:38.357283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a6aa079b-a28b-466f-ad23-80866177e1f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:38.358245 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a6aa079b-a28b-466f-ad23-80866177e1f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:38.364753 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6aa079b-a28b-466f-ad23-80866177e1f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:38.365378 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6aa079b-a28b-466f-ad23-80866177e1f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:38.365922 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6aa079b-a28b-466f-ad23-80866177e1f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:38.366702 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6aa079b-a28b-466f-ad23-80866177e1f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:38.367250 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6aa079b-a28b-466f-ad23-80866177e1f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:38.367828 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6aa079b-a28b-466f-ad23-80866177e1f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:38.514009 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a6aa079b-a28b-466f-ad23-80866177e1f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:38.522905 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a6aa079b-a28b-466f-ad23-80866177e1f0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1368 microversion: 2.1 time: 0.169149 Sep 26 05:31:38.523802 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 183/352] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:38 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:38.528569 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-4160d7cf-a26b-4226-b8be-639a6f48e8bf tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:38.529479 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-4160d7cf-a26b-4226-b8be-639a6f48e8bf tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:38.597131 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-4160d7cf-a26b-4226-b8be-639a6f48e8bf tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:38.604300 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-4160d7cf-a26b-4226-b8be-639a6f48e8bf tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1246 microversion: 2.1 time: 0.079260 Sep 26 05:31:38.605586 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 184/353] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:38 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:38.702729 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2d3f14ce-b7ad-488b-a6c1-c8e75b34de50 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "POST /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.415841 Sep 26 05:31:38.703766 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 170/354] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 05:31:38 2022] POST /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b/os-volume_attachments => generated 194 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:31:39.211694 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-4e10bc35-1271-488d-87cb-c5f5fb379ee8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:39.212320 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-4e10bc35-1271-488d-87cb-c5f5fb379ee8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:39.218288 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4e10bc35-1271-488d-87cb-c5f5fb379ee8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:39.218768 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4e10bc35-1271-488d-87cb-c5f5fb379ee8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:39.219203 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4e10bc35-1271-488d-87cb-c5f5fb379ee8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:39.219881 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4e10bc35-1271-488d-87cb-c5f5fb379ee8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:39.220353 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4e10bc35-1271-488d-87cb-c5f5fb379ee8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:39.220778 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4e10bc35-1271-488d-87cb-c5f5fb379ee8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:39.350931 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-4e10bc35-1271-488d-87cb-c5f5fb379ee8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:39.359254 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-4e10bc35-1271-488d-87cb-c5f5fb379ee8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:39.360783 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-4e10bc35-1271-488d-87cb-c5f5fb379ee8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:39.362556 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-4e10bc35-1271-488d-87cb-c5f5fb379ee8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1744 microversion: 2.20 time: 0.154131 Sep 26 05:31:39.363263 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 185/355] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:39 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:39.376651 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7d8df4e1-6276-492f-ab69-1266c0ca0adf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:39.377363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7d8df4e1-6276-492f-ab69-1266c0ca0adf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:39.384726 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d8df4e1-6276-492f-ab69-1266c0ca0adf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:39.385202 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d8df4e1-6276-492f-ab69-1266c0ca0adf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:39.385632 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d8df4e1-6276-492f-ab69-1266c0ca0adf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:39.386305 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d8df4e1-6276-492f-ab69-1266c0ca0adf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:39.386750 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d8df4e1-6276-492f-ab69-1266c0ca0adf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:39.387162 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d8df4e1-6276-492f-ab69-1266c0ca0adf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:39.514678 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7d8df4e1-6276-492f-ab69-1266c0ca0adf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:39.522877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7d8df4e1-6276-492f-ab69-1266c0ca0adf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1261 microversion: 2.1 time: 0.150387 Sep 26 05:31:39.523451 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 171/356] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:39 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:39.546175 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-00f94608-c71a-4bdd-95ae-7e74bd7260d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:39.546793 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-00f94608-c71a-4bdd-95ae-7e74bd7260d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:39.553209 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-00f94608-c71a-4bdd-95ae-7e74bd7260d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:39.553690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-00f94608-c71a-4bdd-95ae-7e74bd7260d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:39.554122 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-00f94608-c71a-4bdd-95ae-7e74bd7260d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:39.554817 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-00f94608-c71a-4bdd-95ae-7e74bd7260d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:39.555256 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-00f94608-c71a-4bdd-95ae-7e74bd7260d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:39.555679 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-00f94608-c71a-4bdd-95ae-7e74bd7260d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:39.629321 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-51d60227-1bfc-4814-b699-2c4bfa380973 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:39.629850 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-51d60227-1bfc-4814-b699-2c4bfa380973 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:39.635742 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-51d60227-1bfc-4814-b699-2c4bfa380973 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:39.636220 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-51d60227-1bfc-4814-b699-2c4bfa380973 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:39.636693 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-51d60227-1bfc-4814-b699-2c4bfa380973 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:39.637371 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-51d60227-1bfc-4814-b699-2c4bfa380973 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:39.637821 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-51d60227-1bfc-4814-b699-2c4bfa380973 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:39.638236 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-51d60227-1bfc-4814-b699-2c4bfa380973 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:39.691332 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-00f94608-c71a-4bdd-95ae-7e74bd7260d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:39.694944 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=100 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:39.700220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-00f94608-c71a-4bdd-95ae-7e74bd7260d7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1368 microversion: 2.1 time: 0.157992 Sep 26 05:31:39.700806 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 186/357] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:39 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:39.709828 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-51d60227-1bfc-4814-b699-2c4bfa380973 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:39.717485 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-51d60227-1bfc-4814-b699-2c4bfa380973 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1242 microversion: 2.1 time: 0.092630 Sep 26 05:31:39.718036 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 172/358] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:39 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:40.389758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-02d8fdac-17d5-42a6-9c4a-7b40c4df9d9e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:40.390578 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-02d8fdac-17d5-42a6-9c4a-7b40c4df9d9e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:40.398200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-02d8fdac-17d5-42a6-9c4a-7b40c4df9d9e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:40.398783 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-02d8fdac-17d5-42a6-9c4a-7b40c4df9d9e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:40.399480 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-02d8fdac-17d5-42a6-9c4a-7b40c4df9d9e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:40.400393 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-02d8fdac-17d5-42a6-9c4a-7b40c4df9d9e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:40.400913 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-02d8fdac-17d5-42a6-9c4a-7b40c4df9d9e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:40.401407 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-02d8fdac-17d5-42a6-9c4a-7b40c4df9d9e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:40.544154 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-02d8fdac-17d5-42a6-9c4a-7b40c4df9d9e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:40.546461 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-74ac2dcb-49a4-496b-85c7-ad948565d128 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:40.547087 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-74ac2dcb-49a4-496b-85c7-ad948565d128 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:40.553243 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-02d8fdac-17d5-42a6-9c4a-7b40c4df9d9e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:40.554752 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-02d8fdac-17d5-42a6-9c4a-7b40c4df9d9e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:40.555085 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74ac2dcb-49a4-496b-85c7-ad948565d128 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:40.555662 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74ac2dcb-49a4-496b-85c7-ad948565d128 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:40.555970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-02d8fdac-17d5-42a6-9c4a-7b40c4df9d9e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1744 microversion: 2.20 time: 0.171124 Sep 26 05:31:40.556085 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74ac2dcb-49a4-496b-85c7-ad948565d128 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:40.556689 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 187/359] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:40 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:40.561200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-79779719-70f3-422f-81b7-62d5d6a5fb4b req-d955d9a2-5969-4ea8-a36d-5e49210eb54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b60837af-4528-4e98-bb46-0e80e3270c0d", "name": "network-vif-plugged", "status": "completed", "tag": "7672989d-ca9b-46a1-b56a-6c9d7ec17b2d"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:40.568737 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74ac2dcb-49a4-496b-85c7-ad948565d128 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:40.569267 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74ac2dcb-49a4-496b-85c7-ad948565d128 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:40.569710 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74ac2dcb-49a4-496b-85c7-ad948565d128 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:40.571419 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-79779719-70f3-422f-81b7-62d5d6a5fb4b req-d955d9a2-5969-4ea8-a36d-5e49210eb54e service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:40.571894 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-79779719-70f3-422f-81b7-62d5d6a5fb4b req-d955d9a2-5969-4ea8-a36d-5e49210eb54e service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:40.572357 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-79779719-70f3-422f-81b7-62d5d6a5fb4b req-d955d9a2-5969-4ea8-a36d-5e49210eb54e service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:40.584826 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-79779719-70f3-422f-81b7-62d5d6a5fb4b req-d955d9a2-5969-4ea8-a36d-5e49210eb54e service nova] Creating event network-vif-plugged:7672989d-ca9b-46a1-b56a-6c9d7ec17b2d for instance b60837af-4528-4e98-bb46-0e80e3270c0d on hv-cinder-85918 Sep 26 05:31:40.589984 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-79779719-70f3-422f-81b7-62d5d6a5fb4b req-d955d9a2-5969-4ea8-a36d-5e49210eb54e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032288 Sep 26 05:31:40.590876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 188/360] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:31:40.718906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-74ac2dcb-49a4-496b-85c7-ad948565d128 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:40.723718 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6957d1d5-4175-46c6-b481-3b2005992513 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:40.724587 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6957d1d5-4175-46c6-b481-3b2005992513 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:40.726800 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-74ac2dcb-49a4-496b-85c7-ad948565d128 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1261 microversion: 2.1 time: 0.184775 Sep 26 05:31:40.727357 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 173/361] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:40 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:40.734783 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6957d1d5-4175-46c6-b481-3b2005992513 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:40.735330 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6957d1d5-4175-46c6-b481-3b2005992513 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:40.736080 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6957d1d5-4175-46c6-b481-3b2005992513 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:40.736813 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6957d1d5-4175-46c6-b481-3b2005992513 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:40.737273 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6957d1d5-4175-46c6-b481-3b2005992513 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:40.737734 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6957d1d5-4175-46c6-b481-3b2005992513 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:40.741199 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f93d4c6d-6bc7-4d23-baa2-843544f1ae43 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:40.741991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f93d4c6d-6bc7-4d23-baa2-843544f1ae43 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:40.747658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f93d4c6d-6bc7-4d23-baa2-843544f1ae43 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:40.748130 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f93d4c6d-6bc7-4d23-baa2-843544f1ae43 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:40.748590 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f93d4c6d-6bc7-4d23-baa2-843544f1ae43 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:40.749265 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f93d4c6d-6bc7-4d23-baa2-843544f1ae43 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:40.749712 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f93d4c6d-6bc7-4d23-baa2-843544f1ae43 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:40.750127 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f93d4c6d-6bc7-4d23-baa2-843544f1ae43 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:40.827769 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f93d4c6d-6bc7-4d23-baa2-843544f1ae43 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:40.838042 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f93d4c6d-6bc7-4d23-baa2-843544f1ae43 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1298 microversion: 2.1 time: 0.100104 Sep 26 05:31:40.838042 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 174/362] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:40 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1298 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:40.902440 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6957d1d5-4175-46c6-b481-3b2005992513 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:40.908072 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6957d1d5-4175-46c6-b481-3b2005992513 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1559 microversion: 2.1 time: 0.188804 Sep 26 05:31:40.909045 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 189/363] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:40 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:40.931901 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0514184a-6cab-4a15-8dea-8d1985acf213 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:40.932773 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0514184a-6cab-4a15-8dea-8d1985acf213 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:40.944804 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0514184a-6cab-4a15-8dea-8d1985acf213 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:40.945575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0514184a-6cab-4a15-8dea-8d1985acf213 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:40.946361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0514184a-6cab-4a15-8dea-8d1985acf213 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:40.947159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0514184a-6cab-4a15-8dea-8d1985acf213 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:40.947611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0514184a-6cab-4a15-8dea-8d1985acf213 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:40.948030 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0514184a-6cab-4a15-8dea-8d1985acf213 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:41.035408 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0514184a-6cab-4a15-8dea-8d1985acf213 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107645 Sep 26 05:31:41.040434 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 175/364] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 05:31:40 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:31:41.585703 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-eb422316-9579-4055-ab95-774b788ffe34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:41.586331 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-eb422316-9579-4055-ab95-774b788ffe34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:41.592324 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-eb422316-9579-4055-ab95-774b788ffe34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:41.592805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-eb422316-9579-4055-ab95-774b788ffe34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:41.593235 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-eb422316-9579-4055-ab95-774b788ffe34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:41.593908 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-eb422316-9579-4055-ab95-774b788ffe34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:41.594390 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-eb422316-9579-4055-ab95-774b788ffe34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:41.594806 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-eb422316-9579-4055-ab95-774b788ffe34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:41.728374 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-eb422316-9579-4055-ab95-774b788ffe34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:41.737275 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-eb422316-9579-4055-ab95-774b788ffe34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:41.738732 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-eb422316-9579-4055-ab95-774b788ffe34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:41.739868 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-eb422316-9579-4055-ab95-774b788ffe34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1744 microversion: 2.20 time: 0.158080 Sep 26 05:31:41.740435 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 190/365] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:41 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:41.750380 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a5a7a955-fb32-4ff1-b67c-29ba3b381f8d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:41.750989 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a5a7a955-fb32-4ff1-b67c-29ba3b381f8d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:41.757890 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a5a7a955-fb32-4ff1-b67c-29ba3b381f8d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:41.758596 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a5a7a955-fb32-4ff1-b67c-29ba3b381f8d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:41.759027 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a5a7a955-fb32-4ff1-b67c-29ba3b381f8d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:41.759720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a5a7a955-fb32-4ff1-b67c-29ba3b381f8d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:41.760177 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a5a7a955-fb32-4ff1-b67c-29ba3b381f8d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:41.760627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a5a7a955-fb32-4ff1-b67c-29ba3b381f8d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:41.861591 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-2ab9e35c-7d6d-44ba-b4e3-d796de3c1a60 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:41.862939 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-2ab9e35c-7d6d-44ba-b4e3-d796de3c1a60 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:41.869177 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2ab9e35c-7d6d-44ba-b4e3-d796de3c1a60 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:41.870012 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2ab9e35c-7d6d-44ba-b4e3-d796de3c1a60 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:41.870653 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2ab9e35c-7d6d-44ba-b4e3-d796de3c1a60 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:41.871512 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2ab9e35c-7d6d-44ba-b4e3-d796de3c1a60 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:41.872117 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2ab9e35c-7d6d-44ba-b4e3-d796de3c1a60 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:41.872719 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2ab9e35c-7d6d-44ba-b4e3-d796de3c1a60 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:41.898643 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a5a7a955-fb32-4ff1-b67c-29ba3b381f8d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:41.906273 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a5a7a955-fb32-4ff1-b67c-29ba3b381f8d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1261 microversion: 2.1 time: 0.160144 Sep 26 05:31:41.909530 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 176/366] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:41 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:41.946819 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2ab9e35c-7d6d-44ba-b4e3-d796de3c1a60 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:41.954664 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2ab9e35c-7d6d-44ba-b4e3-d796de3c1a60 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1298 microversion: 2.1 time: 0.097797 Sep 26 05:31:41.955218 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 191/367] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:41 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:42.186531 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-12b30fa2-c825-4ea5-a1ad-6ac13aaf5407 req-798f9d96-70de-4179-842c-e28571f10850 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "197dc2cf-12cf-4bf8-8dbd-c05654f127db", "tag": "319e5cdb-1d81-4b83-b357-3d505b372b72"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:42.196992 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-12b30fa2-c825-4ea5-a1ad-6ac13aaf5407 req-798f9d96-70de-4179-842c-e28571f10850 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:42.197469 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-12b30fa2-c825-4ea5-a1ad-6ac13aaf5407 req-798f9d96-70de-4179-842c-e28571f10850 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:42.197899 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-12b30fa2-c825-4ea5-a1ad-6ac13aaf5407 req-798f9d96-70de-4179-842c-e28571f10850 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:42.209729 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-12b30fa2-c825-4ea5-a1ad-6ac13aaf5407 req-798f9d96-70de-4179-842c-e28571f10850 service nova] Creating event network-changed:319e5cdb-1d81-4b83-b357-3d505b372b72 for instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db on hv-cinder-85918 Sep 26 05:31:42.214642 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-12b30fa2-c825-4ea5-a1ad-6ac13aaf5407 req-798f9d96-70de-4179-842c-e28571f10850 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031761 Sep 26 05:31:42.215227 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 177/368] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:31:42.765811 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-fb6a3921-f077-408a-b2fa-a2e333a85b74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:42.766542 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-fb6a3921-f077-408a-b2fa-a2e333a85b74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:42.772795 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fb6a3921-f077-408a-b2fa-a2e333a85b74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:42.773361 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fb6a3921-f077-408a-b2fa-a2e333a85b74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:42.773894 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fb6a3921-f077-408a-b2fa-a2e333a85b74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:42.774695 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fb6a3921-f077-408a-b2fa-a2e333a85b74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:42.775158 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fb6a3921-f077-408a-b2fa-a2e333a85b74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:42.775586 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fb6a3921-f077-408a-b2fa-a2e333a85b74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:42.906215 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-fb6a3921-f077-408a-b2fa-a2e333a85b74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:42.915636 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-fb6a3921-f077-408a-b2fa-a2e333a85b74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:42.917730 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-fb6a3921-f077-408a-b2fa-a2e333a85b74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:42.919154 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-fb6a3921-f077-408a-b2fa-a2e333a85b74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1744 microversion: 2.20 time: 0.157276 Sep 26 05:31:42.935040 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1f07e5d3-246d-4f3c-9e6e-6e06e5e76e9a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:42.936462 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 192/369] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:42 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:42.936808 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1f07e5d3-246d-4f3c-9e6e-6e06e5e76e9a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:42.949344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1f07e5d3-246d-4f3c-9e6e-6e06e5e76e9a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:42.949918 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1f07e5d3-246d-4f3c-9e6e-6e06e5e76e9a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:42.950629 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1f07e5d3-246d-4f3c-9e6e-6e06e5e76e9a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:42.951450 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1f07e5d3-246d-4f3c-9e6e-6e06e5e76e9a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:42.956116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1f07e5d3-246d-4f3c-9e6e-6e06e5e76e9a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:42.956701 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1f07e5d3-246d-4f3c-9e6e-6e06e5e76e9a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:42.979847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f8b59c7f-9209-45e1-bcc4-e5768595b8ad tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:42.980928 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f8b59c7f-9209-45e1-bcc4-e5768595b8ad tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:42.990129 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f8b59c7f-9209-45e1-bcc4-e5768595b8ad tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:42.990730 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f8b59c7f-9209-45e1-bcc4-e5768595b8ad tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:42.991243 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f8b59c7f-9209-45e1-bcc4-e5768595b8ad tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:42.992015 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f8b59c7f-9209-45e1-bcc4-e5768595b8ad tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:42.992563 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f8b59c7f-9209-45e1-bcc4-e5768595b8ad tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:42.993050 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f8b59c7f-9209-45e1-bcc4-e5768595b8ad tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:43.106773 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f8b59c7f-9209-45e1-bcc4-e5768595b8ad tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:43.121162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f8b59c7f-9209-45e1-bcc4-e5768595b8ad tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1306 microversion: 2.1 time: 0.145495 Sep 26 05:31:43.122253 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 193/370] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:42 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1306 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:43.265308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1f07e5d3-246d-4f3c-9e6e-6e06e5e76e9a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:43.276997 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1f07e5d3-246d-4f3c-9e6e-6e06e5e76e9a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1261 microversion: 2.1 time: 0.346226 Sep 26 05:31:43.278238 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 178/371] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:42 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1261 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:43.946570 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-dd9d108c-7d41-4091-973a-e82aec449a2d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:43.947194 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-dd9d108c-7d41-4091-973a-e82aec449a2d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:43.953177 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dd9d108c-7d41-4091-973a-e82aec449a2d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:43.953654 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dd9d108c-7d41-4091-973a-e82aec449a2d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:43.954083 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dd9d108c-7d41-4091-973a-e82aec449a2d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:43.954760 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dd9d108c-7d41-4091-973a-e82aec449a2d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:43.955204 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dd9d108c-7d41-4091-973a-e82aec449a2d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:43.955621 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dd9d108c-7d41-4091-973a-e82aec449a2d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:44.085502 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-dd9d108c-7d41-4091-973a-e82aec449a2d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:44.094279 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-dd9d108c-7d41-4091-973a-e82aec449a2d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:44.095720 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-dd9d108c-7d41-4091-973a-e82aec449a2d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:44.096902 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-dd9d108c-7d41-4091-973a-e82aec449a2d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1739 microversion: 2.20 time: 0.154920 Sep 26 05:31:44.097608 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 194/372] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:43 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:44.144700 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1e1e021e-9019-4549-8b2d-9d6d15872238 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:44.145968 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1e1e021e-9019-4549-8b2d-9d6d15872238 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:44.152373 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e1e021e-9019-4549-8b2d-9d6d15872238 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:44.152850 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e1e021e-9019-4549-8b2d-9d6d15872238 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:44.153284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e1e021e-9019-4549-8b2d-9d6d15872238 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:44.153963 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e1e021e-9019-4549-8b2d-9d6d15872238 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:44.154410 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e1e021e-9019-4549-8b2d-9d6d15872238 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:44.154829 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e1e021e-9019-4549-8b2d-9d6d15872238 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:44.215440 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1e1e021e-9019-4549-8b2d-9d6d15872238 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:44.222983 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1e1e021e-9019-4549-8b2d-9d6d15872238 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1304 microversion: 2.1 time: 0.082056 Sep 26 05:31:44.223539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 179/373] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:44 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1304 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:44.301799 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-60b51ca7-42bd-421c-9531-5adda19a3897 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:44.302415 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-60b51ca7-42bd-421c-9531-5adda19a3897 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:44.308349 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-60b51ca7-42bd-421c-9531-5adda19a3897 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:44.308838 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-60b51ca7-42bd-421c-9531-5adda19a3897 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:44.309275 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-60b51ca7-42bd-421c-9531-5adda19a3897 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:44.309962 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-60b51ca7-42bd-421c-9531-5adda19a3897 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:44.310416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-60b51ca7-42bd-421c-9531-5adda19a3897 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:44.310846 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-60b51ca7-42bd-421c-9531-5adda19a3897 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:44.483682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-60b51ca7-42bd-421c-9531-5adda19a3897 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:44.492117 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-60b51ca7-42bd-421c-9531-5adda19a3897 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1445 microversion: 2.1 time: 0.194279 Sep 26 05:31:44.492714 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 195/374] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:44 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1445 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:44.515979 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0dd01aa0-9779-47cf-bc63-2968ce6d327e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:44.516712 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0dd01aa0-9779-47cf-bc63-2968ce6d327e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:44.523907 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0dd01aa0-9779-47cf-bc63-2968ce6d327e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:44.524606 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0dd01aa0-9779-47cf-bc63-2968ce6d327e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:44.525056 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0dd01aa0-9779-47cf-bc63-2968ce6d327e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:44.526389 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0dd01aa0-9779-47cf-bc63-2968ce6d327e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:44.526853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0dd01aa0-9779-47cf-bc63-2968ce6d327e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:44.527281 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0dd01aa0-9779-47cf-bc63-2968ce6d327e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:44.739681 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0dd01aa0-9779-47cf-bc63-2968ce6d327e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:44.751200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0dd01aa0-9779-47cf-bc63-2968ce6d327e tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1445 microversion: 2.1 time: 0.238999 Sep 26 05:31:44.760428 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 180/375] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:44 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1445 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:45.123205 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-8f44e0a8-b07c-47bd-bc9c-709b48561921 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:45.125897 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-8f44e0a8-b07c-47bd-bc9c-709b48561921 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:45.150087 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8f44e0a8-b07c-47bd-bc9c-709b48561921 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:45.152197 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8f44e0a8-b07c-47bd-bc9c-709b48561921 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:45.154998 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8f44e0a8-b07c-47bd-bc9c-709b48561921 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:45.156576 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8f44e0a8-b07c-47bd-bc9c-709b48561921 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:45.163927 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8f44e0a8-b07c-47bd-bc9c-709b48561921 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:45.167475 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8f44e0a8-b07c-47bd-bc9c-709b48561921 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:45.253858 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-80948445-3e6a-4ab2-b44c-e33c41a4d072 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:45.254544 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-80948445-3e6a-4ab2-b44c-e33c41a4d072 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:45.264549 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-80948445-3e6a-4ab2-b44c-e33c41a4d072 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:45.265031 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-80948445-3e6a-4ab2-b44c-e33c41a4d072 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:45.265461 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-80948445-3e6a-4ab2-b44c-e33c41a4d072 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:45.266168 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-80948445-3e6a-4ab2-b44c-e33c41a4d072 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:45.267239 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-80948445-3e6a-4ab2-b44c-e33c41a4d072 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:45.267943 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-80948445-3e6a-4ab2-b44c-e33c41a4d072 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:45.454371 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8f44e0a8-b07c-47bd-bc9c-709b48561921 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:45.467937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8f44e0a8-b07c-47bd-bc9c-709b48561921 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:45.476148 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8f44e0a8-b07c-47bd-bc9c-709b48561921 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:45.478670 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-8f44e0a8-b07c-47bd-bc9c-709b48561921 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1739 microversion: 2.20 time: 0.359379 Sep 26 05:31:45.479254 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 196/376] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:45 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1739 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:45.601030 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-80948445-3e6a-4ab2-b44c-e33c41a4d072 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:45.616754 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-80948445-3e6a-4ab2-b44c-e33c41a4d072 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.373737 Sep 26 05:31:45.622337 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 181/377] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:45 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:45.817264 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-82203e6e-f305-46d5-a266-668a94a0ab9f req-e0442237-2f2d-4e1a-973a-0a2a8b1aed4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c51093-517b-4a33-9d80-8bf0e1747e75", "tag": "322798b9-1af9-46df-bb99-417d8b1d04b3"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:45.836455 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-82203e6e-f305-46d5-a266-668a94a0ab9f req-e0442237-2f2d-4e1a-973a-0a2a8b1aed4f service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:45.837286 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-82203e6e-f305-46d5-a266-668a94a0ab9f req-e0442237-2f2d-4e1a-973a-0a2a8b1aed4f service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:45.838569 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-82203e6e-f305-46d5-a266-668a94a0ab9f req-e0442237-2f2d-4e1a-973a-0a2a8b1aed4f service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:45.868514 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-82203e6e-f305-46d5-a266-668a94a0ab9f req-e0442237-2f2d-4e1a-973a-0a2a8b1aed4f service nova] Creating event network-changed:322798b9-1af9-46df-bb99-417d8b1d04b3 for instance 30c51093-517b-4a33-9d80-8bf0e1747e75 on hv-cinder-85918 Sep 26 05:31:45.874856 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-82203e6e-f305-46d5-a266-668a94a0ab9f req-e0442237-2f2d-4e1a-973a-0a2a8b1aed4f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062144 Sep 26 05:31:45.884688 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 197/378] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:31:46.508237 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-90db09d8-52f0-4618-9052-b37f9a24dacf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:46.508871 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-90db09d8-52f0-4618-9052-b37f9a24dacf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:46.524645 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90db09d8-52f0-4618-9052-b37f9a24dacf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:46.525468 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90db09d8-52f0-4618-9052-b37f9a24dacf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:46.526258 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90db09d8-52f0-4618-9052-b37f9a24dacf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:46.527137 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90db09d8-52f0-4618-9052-b37f9a24dacf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:46.528212 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90db09d8-52f0-4618-9052-b37f9a24dacf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:46.528955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90db09d8-52f0-4618-9052-b37f9a24dacf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:46.644149 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1f90073f-bb58-4b23-8f96-8e57be890ac0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:46.645639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-1f90073f-bb58-4b23-8f96-8e57be890ac0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:46.653681 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f90073f-bb58-4b23-8f96-8e57be890ac0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:46.654599 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f90073f-bb58-4b23-8f96-8e57be890ac0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:46.655141 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f90073f-bb58-4b23-8f96-8e57be890ac0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:46.655953 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f90073f-bb58-4b23-8f96-8e57be890ac0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:46.656547 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f90073f-bb58-4b23-8f96-8e57be890ac0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:46.657227 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f90073f-bb58-4b23-8f96-8e57be890ac0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:47.016326 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1f90073f-bb58-4b23-8f96-8e57be890ac0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:47.026079 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1f90073f-bb58-4b23-8f96-8e57be890ac0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.386628 Sep 26 05:31:47.027395 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 198/379] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:46 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:47.087532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-90db09d8-52f0-4618-9052-b37f9a24dacf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:47.096384 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-90db09d8-52f0-4618-9052-b37f9a24dacf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:47.098773 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-90db09d8-52f0-4618-9052-b37f9a24dacf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:47.099956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-90db09d8-52f0-4618-9052-b37f9a24dacf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1739 microversion: 2.20 time: 0.596875 Sep 26 05:31:47.117207 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 182/380] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:46 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1739 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:47.799495 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-653d0b80-0a73-4139-9015-d47d7a3989b9 req-b572252a-f9ae-43ac-b94c-d8c15d0e41bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b60837af-4528-4e98-bb46-0e80e3270c0d", "tag": "7672989d-ca9b-46a1-b56a-6c9d7ec17b2d"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:31:47.810743 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-653d0b80-0a73-4139-9015-d47d7a3989b9 req-b572252a-f9ae-43ac-b94c-d8c15d0e41bc service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:47.811583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-653d0b80-0a73-4139-9015-d47d7a3989b9 req-b572252a-f9ae-43ac-b94c-d8c15d0e41bc service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:47.812325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-653d0b80-0a73-4139-9015-d47d7a3989b9 req-b572252a-f9ae-43ac-b94c-d8c15d0e41bc service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:47.825071 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-653d0b80-0a73-4139-9015-d47d7a3989b9 req-b572252a-f9ae-43ac-b94c-d8c15d0e41bc service nova] Creating event network-changed:7672989d-ca9b-46a1-b56a-6c9d7ec17b2d for instance b60837af-4528-4e98-bb46-0e80e3270c0d on hv-cinder-85918 Sep 26 05:31:47.830492 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-653d0b80-0a73-4139-9015-d47d7a3989b9 req-b572252a-f9ae-43ac-b94c-d8c15d0e41bc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034661 Sep 26 05:31:47.831309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 199/381] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:31:48.049927 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c6d00602-30eb-465d-a8cb-36f916a8a558 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:48.050552 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c6d00602-30eb-465d-a8cb-36f916a8a558 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:48.059230 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c6d00602-30eb-465d-a8cb-36f916a8a558 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:48.059969 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c6d00602-30eb-465d-a8cb-36f916a8a558 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:48.060631 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c6d00602-30eb-465d-a8cb-36f916a8a558 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:48.061614 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c6d00602-30eb-465d-a8cb-36f916a8a558 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:48.062648 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c6d00602-30eb-465d-a8cb-36f916a8a558 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:48.063242 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c6d00602-30eb-465d-a8cb-36f916a8a558 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:48.128058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-0f2d17ed-9b78-4c91-aa45-5214533a0ed9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:48.129112 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-0f2d17ed-9b78-4c91-aa45-5214533a0ed9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:48.138931 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f2d17ed-9b78-4c91-aa45-5214533a0ed9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:48.140813 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f2d17ed-9b78-4c91-aa45-5214533a0ed9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:48.141442 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f2d17ed-9b78-4c91-aa45-5214533a0ed9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:48.142331 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f2d17ed-9b78-4c91-aa45-5214533a0ed9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:48.143435 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f2d17ed-9b78-4c91-aa45-5214533a0ed9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:48.144887 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f2d17ed-9b78-4c91-aa45-5214533a0ed9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:48.204728 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:48.225907 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=10 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:48.309143 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c6d00602-30eb-465d-a8cb-36f916a8a558 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:48.318349 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c6d00602-30eb-465d-a8cb-36f916a8a558 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.272716 Sep 26 05:31:48.318935 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 183/382] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:48 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:48.347160 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0f2d17ed-9b78-4c91-aa45-5214533a0ed9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:48.357585 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0f2d17ed-9b78-4c91-aa45-5214533a0ed9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:48.359032 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0f2d17ed-9b78-4c91-aa45-5214533a0ed9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:48.360472 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-0f2d17ed-9b78-4c91-aa45-5214533a0ed9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1739 microversion: 2.20 time: 0.237051 Sep 26 05:31:48.361222 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 200/383] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:48 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:49.344803 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7c2a8ab4-d74d-4ba5-9472-5dc46a0874c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:49.346087 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7c2a8ab4-d74d-4ba5-9472-5dc46a0874c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:49.356608 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c2a8ab4-d74d-4ba5-9472-5dc46a0874c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:49.357380 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c2a8ab4-d74d-4ba5-9472-5dc46a0874c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:49.357930 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c2a8ab4-d74d-4ba5-9472-5dc46a0874c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:49.359077 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c2a8ab4-d74d-4ba5-9472-5dc46a0874c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:49.359949 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c2a8ab4-d74d-4ba5-9472-5dc46a0874c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:49.360796 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c2a8ab4-d74d-4ba5-9472-5dc46a0874c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:49.387792 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-24c0abe1-515f-49b8-be68-714019154280 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:49.390450 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-24c0abe1-515f-49b8-be68-714019154280 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:49.392355 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:49.399695 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:49.402475 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-24c0abe1-515f-49b8-be68-714019154280 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:49.403389 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-24c0abe1-515f-49b8-be68-714019154280 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:49.421384 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-24c0abe1-515f-49b8-be68-714019154280 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:49.422679 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-24c0abe1-515f-49b8-be68-714019154280 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:49.423370 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-24c0abe1-515f-49b8-be68-714019154280 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:49.424175 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-24c0abe1-515f-49b8-be68-714019154280 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:49.603029 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7c2a8ab4-d74d-4ba5-9472-5dc46a0874c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:49.615688 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7c2a8ab4-d74d-4ba5-9472-5dc46a0874c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.275183 Sep 26 05:31:49.636948 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 184/384] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:49 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:49.659401 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-24c0abe1-515f-49b8-be68-714019154280 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:49.685257 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-24c0abe1-515f-49b8-be68-714019154280 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:49.688163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-24c0abe1-515f-49b8-be68-714019154280 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:49.689597 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-24c0abe1-515f-49b8-be68-714019154280 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1739 microversion: 2.20 time: 0.306209 Sep 26 05:31:49.705913 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 201/385] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:49 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1739 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:50.648610 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ba138759-6d40-4a11-8259-cfa0789abe77 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:50.649343 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ba138759-6d40-4a11-8259-cfa0789abe77 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:50.660184 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ba138759-6d40-4a11-8259-cfa0789abe77 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:50.663962 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ba138759-6d40-4a11-8259-cfa0789abe77 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:50.665292 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ba138759-6d40-4a11-8259-cfa0789abe77 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:50.668839 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ba138759-6d40-4a11-8259-cfa0789abe77 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:50.669628 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ba138759-6d40-4a11-8259-cfa0789abe77 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:50.670892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ba138759-6d40-4a11-8259-cfa0789abe77 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:50.722570 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b7a7235c-4ad2-4a29-af9f-5620b5300322 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:50.725727 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b7a7235c-4ad2-4a29-af9f-5620b5300322 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:50.752382 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b7a7235c-4ad2-4a29-af9f-5620b5300322 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:50.754950 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b7a7235c-4ad2-4a29-af9f-5620b5300322 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:50.760633 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b7a7235c-4ad2-4a29-af9f-5620b5300322 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:50.762138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b7a7235c-4ad2-4a29-af9f-5620b5300322 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:50.765306 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b7a7235c-4ad2-4a29-af9f-5620b5300322 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:50.765747 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b7a7235c-4ad2-4a29-af9f-5620b5300322 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:51.208807 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ba138759-6d40-4a11-8259-cfa0789abe77 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:51.214898 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b7a7235c-4ad2-4a29-af9f-5620b5300322 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:51.221475 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ba138759-6d40-4a11-8259-cfa0789abe77 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.577872 Sep 26 05:31:51.228275 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b7a7235c-4ad2-4a29-af9f-5620b5300322 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:51.229214 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 185/386] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:50 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:51.229733 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b7a7235c-4ad2-4a29-af9f-5620b5300322 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:51.231019 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b7a7235c-4ad2-4a29-af9f-5620b5300322 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1739 microversion: 2.20 time: 0.518616 Sep 26 05:31:51.231567 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 202/387] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:50 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1739 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:31:52.255684 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fe256d9a-643f-4e1d-b369-6b3eeb233b92 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:52.256328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fe256d9a-643f-4e1d-b369-6b3eeb233b92 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:52.259569 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-277e4864-4088-4a00-911c-aa0498f48421 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:52.260199 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-277e4864-4088-4a00-911c-aa0498f48421 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:52.263153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe256d9a-643f-4e1d-b369-6b3eeb233b92 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:52.263651 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe256d9a-643f-4e1d-b369-6b3eeb233b92 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:52.264078 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe256d9a-643f-4e1d-b369-6b3eeb233b92 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:52.264979 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe256d9a-643f-4e1d-b369-6b3eeb233b92 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:52.265604 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe256d9a-643f-4e1d-b369-6b3eeb233b92 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:52.266186 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe256d9a-643f-4e1d-b369-6b3eeb233b92 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:52.266907 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-277e4864-4088-4a00-911c-aa0498f48421 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:52.267944 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-277e4864-4088-4a00-911c-aa0498f48421 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:52.268583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-277e4864-4088-4a00-911c-aa0498f48421 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:52.269457 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-277e4864-4088-4a00-911c-aa0498f48421 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:52.270454 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-277e4864-4088-4a00-911c-aa0498f48421 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:52.271145 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-277e4864-4088-4a00-911c-aa0498f48421 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:52.483819 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-277e4864-4088-4a00-911c-aa0498f48421 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:52.493319 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-277e4864-4088-4a00-911c-aa0498f48421 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:52.493569 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fe256d9a-643f-4e1d-b369-6b3eeb233b92 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:52.495595 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-277e4864-4088-4a00-911c-aa0498f48421 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:52.497943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-277e4864-4088-4a00-911c-aa0498f48421 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1739 microversion: 2.20 time: 0.243613 Sep 26 05:31:52.499449 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 203/388] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:52 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:31:52.514648 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fe256d9a-643f-4e1d-b369-6b3eeb233b92 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.265249 Sep 26 05:31:52.525464 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 186/389] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:52 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:53.529669 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d84e1ed8-83b8-49b3-a2ba-7de21099b1d8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:53.530278 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d84e1ed8-83b8-49b3-a2ba-7de21099b1d8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:53.537530 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d84e1ed8-83b8-49b3-a2ba-7de21099b1d8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:53.538021 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d84e1ed8-83b8-49b3-a2ba-7de21099b1d8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:53.538502 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d84e1ed8-83b8-49b3-a2ba-7de21099b1d8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:53.539391 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d84e1ed8-83b8-49b3-a2ba-7de21099b1d8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:53.539843 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d84e1ed8-83b8-49b3-a2ba-7de21099b1d8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:53.540346 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d84e1ed8-83b8-49b3-a2ba-7de21099b1d8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:53.543193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-806668e8-38f6-4e57-a601-ae9e9a667a90 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:53.544449 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-806668e8-38f6-4e57-a601-ae9e9a667a90 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:53.552393 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-806668e8-38f6-4e57-a601-ae9e9a667a90 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:53.555419 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-806668e8-38f6-4e57-a601-ae9e9a667a90 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:53.556055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-806668e8-38f6-4e57-a601-ae9e9a667a90 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:53.557065 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-806668e8-38f6-4e57-a601-ae9e9a667a90 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:53.557950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-806668e8-38f6-4e57-a601-ae9e9a667a90 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:53.559411 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-806668e8-38f6-4e57-a601-ae9e9a667a90 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:53.750855 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d84e1ed8-83b8-49b3-a2ba-7de21099b1d8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:53.764270 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d84e1ed8-83b8-49b3-a2ba-7de21099b1d8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:53.765990 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d84e1ed8-83b8-49b3-a2ba-7de21099b1d8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:53.767378 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d84e1ed8-83b8-49b3-a2ba-7de21099b1d8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1739 microversion: 2.20 time: 0.241564 Sep 26 05:31:53.768102 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 204/390] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:53 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:31:53.795133 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-806668e8-38f6-4e57-a601-ae9e9a667a90 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:53.803503 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-806668e8-38f6-4e57-a601-ae9e9a667a90 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.269556 Sep 26 05:31:53.806034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 187/391] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:53 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:54.793565 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e178231e-1650-4fb9-ba8c-ffa9e6b67a53 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:54.794918 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e178231e-1650-4fb9-ba8c-ffa9e6b67a53 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:54.802339 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e178231e-1650-4fb9-ba8c-ffa9e6b67a53 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:54.803128 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e178231e-1650-4fb9-ba8c-ffa9e6b67a53 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:54.803814 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e178231e-1650-4fb9-ba8c-ffa9e6b67a53 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:54.804782 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e178231e-1650-4fb9-ba8c-ffa9e6b67a53 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:54.805484 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e178231e-1650-4fb9-ba8c-ffa9e6b67a53 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:54.805943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e178231e-1650-4fb9-ba8c-ffa9e6b67a53 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:54.828369 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=100 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:54.829433 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ea14041f-4e9f-465e-8f34-401c895cf72f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:54.830652 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ea14041f-4e9f-465e-8f34-401c895cf72f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:54.838489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ea14041f-4e9f-465e-8f34-401c895cf72f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:54.841560 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ea14041f-4e9f-465e-8f34-401c895cf72f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:54.842312 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ea14041f-4e9f-465e-8f34-401c895cf72f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:54.843462 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ea14041f-4e9f-465e-8f34-401c895cf72f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:54.844141 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ea14041f-4e9f-465e-8f34-401c895cf72f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:54.844807 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ea14041f-4e9f-465e-8f34-401c895cf72f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:55.030250 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e178231e-1650-4fb9-ba8c-ffa9e6b67a53 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:55.041808 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e178231e-1650-4fb9-ba8c-ffa9e6b67a53 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:55.047150 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e178231e-1650-4fb9-ba8c-ffa9e6b67a53 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:55.050909 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e178231e-1650-4fb9-ba8c-ffa9e6b67a53 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1739 microversion: 2.20 time: 0.260785 Sep 26 05:31:55.067070 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ea14041f-4e9f-465e-8f34-401c895cf72f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:55.075345 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 205/392] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:54 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:55.077658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ea14041f-4e9f-465e-8f34-401c895cf72f tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.253814 Sep 26 05:31:55.078839 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 188/393] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:54 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:56.081325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e1bd207c-a4dc-4c89-b2f3-43648c3437f5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:56.081995 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e1bd207c-a4dc-4c89-b2f3-43648c3437f5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:56.088125 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e1bd207c-a4dc-4c89-b2f3-43648c3437f5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:56.088647 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e1bd207c-a4dc-4c89-b2f3-43648c3437f5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:56.089078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e1bd207c-a4dc-4c89-b2f3-43648c3437f5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:56.089763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e1bd207c-a4dc-4c89-b2f3-43648c3437f5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:56.090210 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e1bd207c-a4dc-4c89-b2f3-43648c3437f5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:56.090626 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e1bd207c-a4dc-4c89-b2f3-43648c3437f5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:56.103425 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cfa0c1e8-a77e-4202-ad59-6f380d1f743b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:56.103968 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cfa0c1e8-a77e-4202-ad59-6f380d1f743b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:56.111652 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cfa0c1e8-a77e-4202-ad59-6f380d1f743b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:56.112416 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cfa0c1e8-a77e-4202-ad59-6f380d1f743b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:56.112629 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cfa0c1e8-a77e-4202-ad59-6f380d1f743b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:56.114109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cfa0c1e8-a77e-4202-ad59-6f380d1f743b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:56.114669 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cfa0c1e8-a77e-4202-ad59-6f380d1f743b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:56.115101 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cfa0c1e8-a77e-4202-ad59-6f380d1f743b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:56.273787 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e1bd207c-a4dc-4c89-b2f3-43648c3437f5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:56.281835 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e1bd207c-a4dc-4c89-b2f3-43648c3437f5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:56.283301 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e1bd207c-a4dc-4c89-b2f3-43648c3437f5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:56.284692 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e1bd207c-a4dc-4c89-b2f3-43648c3437f5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1739 microversion: 2.20 time: 0.207229 Sep 26 05:31:56.290337 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 206/394] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:56 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:56.297488 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cfa0c1e8-a77e-4202-ad59-6f380d1f743b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:56.310715 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cfa0c1e8-a77e-4202-ad59-6f380d1f743b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.211104 Sep 26 05:31:56.311291 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 189/395] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:56 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:57.314333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-889babc8-147d-4259-9e27-dd2054923696 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:57.314949 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-889babc8-147d-4259-9e27-dd2054923696 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:57.321554 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-889babc8-147d-4259-9e27-dd2054923696 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:57.322036 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-889babc8-147d-4259-9e27-dd2054923696 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:57.322475 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-889babc8-147d-4259-9e27-dd2054923696 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:57.323155 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-889babc8-147d-4259-9e27-dd2054923696 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:57.323608 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-889babc8-147d-4259-9e27-dd2054923696 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:57.324032 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-889babc8-147d-4259-9e27-dd2054923696 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:57.333011 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2eb6636e-a3c9-4231-b54b-ae40327ac883 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:57.333620 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2eb6636e-a3c9-4231-b54b-ae40327ac883 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:57.339635 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2eb6636e-a3c9-4231-b54b-ae40327ac883 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:57.340122 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2eb6636e-a3c9-4231-b54b-ae40327ac883 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:57.340610 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2eb6636e-a3c9-4231-b54b-ae40327ac883 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:57.341298 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2eb6636e-a3c9-4231-b54b-ae40327ac883 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:57.341747 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2eb6636e-a3c9-4231-b54b-ae40327ac883 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:57.342170 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2eb6636e-a3c9-4231-b54b-ae40327ac883 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:57.521657 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-889babc8-147d-4259-9e27-dd2054923696 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:57.525766 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2eb6636e-a3c9-4231-b54b-ae40327ac883 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:57.530222 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-889babc8-147d-4259-9e27-dd2054923696 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:57.531721 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-889babc8-147d-4259-9e27-dd2054923696 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:57.532986 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-889babc8-147d-4259-9e27-dd2054923696 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1721 microversion: 2.20 time: 0.222571 Sep 26 05:31:57.533277 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2eb6636e-a3c9-4231-b54b-ae40327ac883 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.204006 Sep 26 05:31:57.533678 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 207/396] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:57 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:31:57.534084 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 190/397] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:57 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:31:58.554801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d386f6e0-2c34-40d9-861c-81d5d6e6f7cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:58.555410 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d386f6e0-2c34-40d9-861c-81d5d6e6f7cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:58.561325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d386f6e0-2c34-40d9-861c-81d5d6e6f7cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:58.561805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d386f6e0-2c34-40d9-861c-81d5d6e6f7cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:58.562236 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d386f6e0-2c34-40d9-861c-81d5d6e6f7cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:58.562669 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1dddd9c1-b0d8-4202-8977-e25712d27da4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:58.563042 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d386f6e0-2c34-40d9-861c-81d5d6e6f7cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:58.563311 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1dddd9c1-b0d8-4202-8977-e25712d27da4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:58.563420 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d386f6e0-2c34-40d9-861c-81d5d6e6f7cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:58.563755 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d386f6e0-2c34-40d9-861c-81d5d6e6f7cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:58.570251 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1dddd9c1-b0d8-4202-8977-e25712d27da4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:58.570726 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1dddd9c1-b0d8-4202-8977-e25712d27da4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:58.571155 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1dddd9c1-b0d8-4202-8977-e25712d27da4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:58.571831 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1dddd9c1-b0d8-4202-8977-e25712d27da4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:58.572294 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1dddd9c1-b0d8-4202-8977-e25712d27da4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:58.572711 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1dddd9c1-b0d8-4202-8977-e25712d27da4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:58.752861 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d386f6e0-2c34-40d9-861c-81d5d6e6f7cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:58.760650 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1dddd9c1-b0d8-4202-8977-e25712d27da4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:58.761298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d386f6e0-2c34-40d9-861c-81d5d6e6f7cd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.210228 Sep 26 05:31:58.761877 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 208/398] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:58 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:58.768944 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1dddd9c1-b0d8-4202-8977-e25712d27da4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:58.770880 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1dddd9c1-b0d8-4202-8977-e25712d27da4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:58.772036 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1dddd9c1-b0d8-4202-8977-e25712d27da4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1721 microversion: 2.20 time: 0.213242 Sep 26 05:31:58.772619 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 191/399] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:58 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:31:59.783577 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-dace6c11-1144-499a-97ce-60757fb776f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:59.784193 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-dace6c11-1144-499a-97ce-60757fb776f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:59.791159 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dace6c11-1144-499a-97ce-60757fb776f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:59.791649 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dace6c11-1144-499a-97ce-60757fb776f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:59.792084 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dace6c11-1144-499a-97ce-60757fb776f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:59.792800 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dace6c11-1144-499a-97ce-60757fb776f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:59.793253 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dace6c11-1144-499a-97ce-60757fb776f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:59.793680 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dace6c11-1144-499a-97ce-60757fb776f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:59.796582 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6f4c19e7-5d64-422a-918e-cc81bc29e418 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:31:59.797333 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6f4c19e7-5d64-422a-918e-cc81bc29e418 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:31:59.803791 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f4c19e7-5d64-422a-918e-cc81bc29e418 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:59.804295 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f4c19e7-5d64-422a-918e-cc81bc29e418 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:59.804734 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f4c19e7-5d64-422a-918e-cc81bc29e418 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:59.805419 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f4c19e7-5d64-422a-918e-cc81bc29e418 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:31:59.805869 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f4c19e7-5d64-422a-918e-cc81bc29e418 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:31:59.806290 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f4c19e7-5d64-422a-918e-cc81bc29e418 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:31:59.994060 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-dace6c11-1144-499a-97ce-60757fb776f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:31:59.997715 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6f4c19e7-5d64-422a-918e-cc81bc29e418 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:00.001801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-dace6c11-1144-499a-97ce-60757fb776f4 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.222051 Sep 26 05:32:00.002370 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 209/400] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:31:59 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:00.006384 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6f4c19e7-5d64-422a-918e-cc81bc29e418 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:00.007828 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6f4c19e7-5d64-422a-918e-cc81bc29e418 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:00.008996 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6f4c19e7-5d64-422a-918e-cc81bc29e418 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1721 microversion: 2.20 time: 0.216289 Sep 26 05:32:00.009542 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 192/401] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:31:59 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:32:00.870597 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-260d8f07-b49d-4cab-a76c-3aec36e1777c req-643ad584-1388-417f-8f77-e3e89c0c0cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c51093-517b-4a33-9d80-8bf0e1747e75", "name": "network-vif-plugged", "status": "completed", "tag": "322798b9-1af9-46df-bb99-417d8b1d04b3"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:32:00.880048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-260d8f07-b49d-4cab-a76c-3aec36e1777c req-643ad584-1388-417f-8f77-e3e89c0c0cb9 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:00.880620 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-260d8f07-b49d-4cab-a76c-3aec36e1777c req-643ad584-1388-417f-8f77-e3e89c0c0cb9 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:00.881044 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-260d8f07-b49d-4cab-a76c-3aec36e1777c req-643ad584-1388-417f-8f77-e3e89c0c0cb9 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:00.892705 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-260d8f07-b49d-4cab-a76c-3aec36e1777c req-643ad584-1388-417f-8f77-e3e89c0c0cb9 service nova] Creating event network-vif-plugged:322798b9-1af9-46df-bb99-417d8b1d04b3 for instance 30c51093-517b-4a33-9d80-8bf0e1747e75 on hv-cinder-85918 Sep 26 05:32:00.897738 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-260d8f07-b49d-4cab-a76c-3aec36e1777c req-643ad584-1388-417f-8f77-e3e89c0c0cb9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030805 Sep 26 05:32:00.898322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 210/402] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:32:01.025756 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5f598a18-b859-4634-98c9-5605a4e4ab52 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:01.026367 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5f598a18-b859-4634-98c9-5605a4e4ab52 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:01.033002 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f598a18-b859-4634-98c9-5605a4e4ab52 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:01.033485 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f598a18-b859-4634-98c9-5605a4e4ab52 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:01.033971 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f598a18-b859-4634-98c9-5605a4e4ab52 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:01.034670 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f598a18-b859-4634-98c9-5605a4e4ab52 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:01.035410 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9e5db2e6-1035-4750-b2b3-2876d47bb629 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:01.035801 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f598a18-b859-4634-98c9-5605a4e4ab52 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:01.036174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-9e5db2e6-1035-4750-b2b3-2876d47bb629 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:01.036296 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f598a18-b859-4634-98c9-5605a4e4ab52 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:01.042203 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9e5db2e6-1035-4750-b2b3-2876d47bb629 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:01.042680 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9e5db2e6-1035-4750-b2b3-2876d47bb629 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:01.043111 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9e5db2e6-1035-4750-b2b3-2876d47bb629 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:01.043841 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9e5db2e6-1035-4750-b2b3-2876d47bb629 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:01.044317 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9e5db2e6-1035-4750-b2b3-2876d47bb629 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:01.044746 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9e5db2e6-1035-4750-b2b3-2876d47bb629 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:01.235233 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5f598a18-b859-4634-98c9-5605a4e4ab52 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:01.242446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-9e5db2e6-1035-4750-b2b3-2876d47bb629 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:01.244077 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5f598a18-b859-4634-98c9-5605a4e4ab52 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.222099 Sep 26 05:32:01.244689 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 193/403] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:01 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:01.250768 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-9e5db2e6-1035-4750-b2b3-2876d47bb629 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:01.252390 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-9e5db2e6-1035-4750-b2b3-2876d47bb629 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:01.253876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-9e5db2e6-1035-4750-b2b3-2876d47bb629 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1721 microversion: 2.20 time: 0.223080 Sep 26 05:32:01.254743 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 211/404] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:01 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:32:02.266431 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a5f69d05-6b73-4628-9527-d3303dd488c2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:02.267111 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a5f69d05-6b73-4628-9527-d3303dd488c2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:02.273652 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a5f69d05-6b73-4628-9527-d3303dd488c2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:02.276001 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a5f69d05-6b73-4628-9527-d3303dd488c2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:02.276001 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a5f69d05-6b73-4628-9527-d3303dd488c2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:02.276001 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a5f69d05-6b73-4628-9527-d3303dd488c2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:02.276001 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a5f69d05-6b73-4628-9527-d3303dd488c2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:02.276402 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a5f69d05-6b73-4628-9527-d3303dd488c2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:02.280124 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-43ecd001-0bef-475b-8f48-2bdcd454d7a5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:02.280764 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-43ecd001-0bef-475b-8f48-2bdcd454d7a5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:02.287104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-43ecd001-0bef-475b-8f48-2bdcd454d7a5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:02.287580 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-43ecd001-0bef-475b-8f48-2bdcd454d7a5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:02.288008 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-43ecd001-0bef-475b-8f48-2bdcd454d7a5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:02.288722 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-43ecd001-0bef-475b-8f48-2bdcd454d7a5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:02.289167 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-43ecd001-0bef-475b-8f48-2bdcd454d7a5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:02.289584 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-43ecd001-0bef-475b-8f48-2bdcd454d7a5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:02.468836 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a5f69d05-6b73-4628-9527-d3303dd488c2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:02.473192 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-43ecd001-0bef-475b-8f48-2bdcd454d7a5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:02.477211 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a5f69d05-6b73-4628-9527-d3303dd488c2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.214600 Sep 26 05:32:02.477787 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 194/405] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:02 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:02.481146 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-43ecd001-0bef-475b-8f48-2bdcd454d7a5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:02.482835 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-43ecd001-0bef-475b-8f48-2bdcd454d7a5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:02.483972 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-43ecd001-0bef-475b-8f48-2bdcd454d7a5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1721 microversion: 2.20 time: 0.207695 Sep 26 05:32:02.484555 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 212/406] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:02 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:32:03.500572 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c9ec63a6-dc6c-4e5c-a7a8-c43ae8ef80e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:03.501181 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c9ec63a6-dc6c-4e5c-a7a8-c43ae8ef80e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:03.508097 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c9ec63a6-dc6c-4e5c-a7a8-c43ae8ef80e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:03.508603 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c9ec63a6-dc6c-4e5c-a7a8-c43ae8ef80e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:03.509035 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c9ec63a6-dc6c-4e5c-a7a8-c43ae8ef80e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:03.509750 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c9ec63a6-dc6c-4e5c-a7a8-c43ae8ef80e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:03.510107 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-eb6800ab-429a-4c97-95be-6e4611affc9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:03.510528 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c9ec63a6-dc6c-4e5c-a7a8-c43ae8ef80e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:03.510652 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c9ec63a6-dc6c-4e5c-a7a8-c43ae8ef80e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:03.510763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-eb6800ab-429a-4c97-95be-6e4611affc9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:03.516541 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-eb6800ab-429a-4c97-95be-6e4611affc9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:03.517022 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-eb6800ab-429a-4c97-95be-6e4611affc9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:03.517454 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-eb6800ab-429a-4c97-95be-6e4611affc9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:03.518136 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-eb6800ab-429a-4c97-95be-6e4611affc9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:03.518585 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-eb6800ab-429a-4c97-95be-6e4611affc9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:03.519045 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-eb6800ab-429a-4c97-95be-6e4611affc9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:03.933648 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c9ec63a6-dc6c-4e5c-a7a8-c43ae8ef80e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:03.937207 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-eb6800ab-429a-4c97-95be-6e4611affc9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:03.942080 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c9ec63a6-dc6c-4e5c-a7a8-c43ae8ef80e5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.445315 Sep 26 05:32:03.942657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 195/407] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:03 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:03.945955 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-eb6800ab-429a-4c97-95be-6e4611affc9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:03.947432 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-eb6800ab-429a-4c97-95be-6e4611affc9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:03.948637 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-eb6800ab-429a-4c97-95be-6e4611affc9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1721 microversion: 2.20 time: 0.442533 Sep 26 05:32:03.949201 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 213/408] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:03 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1721 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:32:04.965539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ccb5f6aa-a8e1-48fe-8145-00b0f3477b19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:04.966160 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ccb5f6aa-a8e1-48fe-8145-00b0f3477b19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:04.968584 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:04.973567 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-40aa5a7c-3841-45e1-b49c-92d8ae7fca5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:04.974120 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ccb5f6aa-a8e1-48fe-8145-00b0f3477b19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:04.974245 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-40aa5a7c-3841-45e1-b49c-92d8ae7fca5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:04.974608 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ccb5f6aa-a8e1-48fe-8145-00b0f3477b19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:04.975046 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ccb5f6aa-a8e1-48fe-8145-00b0f3477b19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:04.975738 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ccb5f6aa-a8e1-48fe-8145-00b0f3477b19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:04.976197 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ccb5f6aa-a8e1-48fe-8145-00b0f3477b19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:04.976673 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ccb5f6aa-a8e1-48fe-8145-00b0f3477b19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:04.980014 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-40aa5a7c-3841-45e1-b49c-92d8ae7fca5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:04.980518 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-40aa5a7c-3841-45e1-b49c-92d8ae7fca5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:04.980946 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-40aa5a7c-3841-45e1-b49c-92d8ae7fca5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:04.981621 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-40aa5a7c-3841-45e1-b49c-92d8ae7fca5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:04.982329 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-40aa5a7c-3841-45e1-b49c-92d8ae7fca5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:04.982747 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-40aa5a7c-3841-45e1-b49c-92d8ae7fca5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:05.167351 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ccb5f6aa-a8e1-48fe-8145-00b0f3477b19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:05.174107 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-40aa5a7c-3841-45e1-b49c-92d8ae7fca5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:05.175800 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ccb5f6aa-a8e1-48fe-8145-00b0f3477b19 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.213320 Sep 26 05:32:05.176219 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 196/409] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:04 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:05.183213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-40aa5a7c-3841-45e1-b49c-92d8ae7fca5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:05.184683 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-40aa5a7c-3841-45e1-b49c-92d8ae7fca5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:05.185834 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-40aa5a7c-3841-45e1-b49c-92d8ae7fca5d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1721 microversion: 2.20 time: 0.216343 Sep 26 05:32:05.186401 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 214/410] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:04 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:32:06.068060 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-637991c3-e8dd-44cf-a767-0e0f9f7d75ce req-c7201386-ccc5-4f8b-bac2-83244e777cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffa337e-39e1-4edc-9a0d-4468ff05c577", "name": "network-vif-unplugged", "status": "completed", "tag": "db14dfec-952b-46e2-9617-72801c005bb3"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:32:06.078208 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-637991c3-e8dd-44cf-a767-0e0f9f7d75ce req-c7201386-ccc5-4f8b-bac2-83244e777cfb service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:06.079021 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-637991c3-e8dd-44cf-a767-0e0f9f7d75ce req-c7201386-ccc5-4f8b-bac2-83244e777cfb service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:06.079455 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-637991c3-e8dd-44cf-a767-0e0f9f7d75ce req-c7201386-ccc5-4f8b-bac2-83244e777cfb service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:06.093927 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-637991c3-e8dd-44cf-a767-0e0f9f7d75ce req-c7201386-ccc5-4f8b-bac2-83244e777cfb service nova] Creating event network-vif-unplugged:db14dfec-952b-46e2-9617-72801c005bb3 for instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 on hv-cinder-85918 Sep 26 05:32:06.099347 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-637991c3-e8dd-44cf-a767-0e0f9f7d75ce req-c7201386-ccc5-4f8b-bac2-83244e777cfb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036196 Sep 26 05:32:06.099947 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 197/411] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:32:06.197893 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f96fb7e9-7ef6-4c87-85b0-534378f6b278 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:06.198497 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f96fb7e9-7ef6-4c87-85b0-534378f6b278 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:06.204432 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f96fb7e9-7ef6-4c87-85b0-534378f6b278 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:06.204916 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f96fb7e9-7ef6-4c87-85b0-534378f6b278 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:06.205350 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f96fb7e9-7ef6-4c87-85b0-534378f6b278 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:06.206943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f96fb7e9-7ef6-4c87-85b0-534378f6b278 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:06.207616 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f96fb7e9-7ef6-4c87-85b0-534378f6b278 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:06.208049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f96fb7e9-7ef6-4c87-85b0-534378f6b278 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:06.212034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9ae6d58c-8d19-4017-b48e-1a6d040d135e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:06.212759 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9ae6d58c-8d19-4017-b48e-1a6d040d135e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:06.218827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9ae6d58c-8d19-4017-b48e-1a6d040d135e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:06.219305 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9ae6d58c-8d19-4017-b48e-1a6d040d135e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:06.219741 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9ae6d58c-8d19-4017-b48e-1a6d040d135e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:06.220452 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9ae6d58c-8d19-4017-b48e-1a6d040d135e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:06.220903 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9ae6d58c-8d19-4017-b48e-1a6d040d135e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:06.221324 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9ae6d58c-8d19-4017-b48e-1a6d040d135e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:06.413449 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f96fb7e9-7ef6-4c87-85b0-534378f6b278 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:06.419615 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9ae6d58c-8d19-4017-b48e-1a6d040d135e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:06.421476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f96fb7e9-7ef6-4c87-85b0-534378f6b278 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.227542 Sep 26 05:32:06.422039 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 215/412] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:06 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:06.428495 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9ae6d58c-8d19-4017-b48e-1a6d040d135e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:06.429937 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9ae6d58c-8d19-4017-b48e-1a6d040d135e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:06.431073 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9ae6d58c-8d19-4017-b48e-1a6d040d135e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1721 microversion: 2.20 time: 0.223447 Sep 26 05:32:06.431608 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 198/413] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:06 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:32:07.446138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e01b4e09-189f-48a4-83b9-2eefac8e2bf7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:07.446769 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e01b4e09-189f-48a4-83b9-2eefac8e2bf7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:07.452333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=76 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:07.454322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e01b4e09-189f-48a4-83b9-2eefac8e2bf7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:07.455032 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e01b4e09-189f-48a4-83b9-2eefac8e2bf7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:07.455604 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e01b4e09-189f-48a4-83b9-2eefac8e2bf7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:07.457119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e01b4e09-189f-48a4-83b9-2eefac8e2bf7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:07.457653 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e01b4e09-189f-48a4-83b9-2eefac8e2bf7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:07.458199 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e01b4e09-189f-48a4-83b9-2eefac8e2bf7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:07.458572 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-715b62ea-589a-47b4-9da9-8f0ddd207466 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:07.459180 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-715b62ea-589a-47b4-9da9-8f0ddd207466 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:07.466663 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-715b62ea-589a-47b4-9da9-8f0ddd207466 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:07.467152 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-715b62ea-589a-47b4-9da9-8f0ddd207466 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:07.467592 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-715b62ea-589a-47b4-9da9-8f0ddd207466 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:07.468410 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-715b62ea-589a-47b4-9da9-8f0ddd207466 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:07.468759 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-715b62ea-589a-47b4-9da9-8f0ddd207466 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:07.469183 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-715b62ea-589a-47b4-9da9-8f0ddd207466 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:07.698500 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-715b62ea-589a-47b4-9da9-8f0ddd207466 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:07.705926 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e01b4e09-189f-48a4-83b9-2eefac8e2bf7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:07.707420 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-715b62ea-589a-47b4-9da9-8f0ddd207466 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:07.708920 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-715b62ea-589a-47b4-9da9-8f0ddd207466 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:07.710075 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-715b62ea-589a-47b4-9da9-8f0ddd207466 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1724 microversion: 2.20 time: 0.256433 Sep 26 05:32:07.710628 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 199/414] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:07 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:07.714227 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e01b4e09-189f-48a4-83b9-2eefac8e2bf7 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.273367 Sep 26 05:32:07.714786 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 216/415] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:07 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:07.736428 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9eda584a-8269-4a90-9b64-980f8895564e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de439b40-a652-4ed0-9b27-d7e1af8759a4"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:32:07.740049 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9eda584a-8269-4a90-9b64-980f8895564e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:07.746153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9eda584a-8269-4a90-9b64-980f8895564e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:07.746637 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9eda584a-8269-4a90-9b64-980f8895564e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:07.747073 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9eda584a-8269-4a90-9b64-980f8895564e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:07.747766 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9eda584a-8269-4a90-9b64-980f8895564e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:07.748224 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9eda584a-8269-4a90-9b64-980f8895564e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:07.748678 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9eda584a-8269-4a90-9b64-980f8895564e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:07.923223 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:08.056832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9eda584a-8269-4a90-9b64-980f8895564e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "POST /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.324300 Sep 26 05:32:08.057439 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 200/416] 10.222.0.49 () {62 vars in 1364 bytes} [Mon Sep 26 05:32:07 2022] POST /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:32:08.186918 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-2df844a6-a299-4550-84ee-8f5fa1f86286 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:32:08.187551 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-2df844a6-a299-4550-84ee-8f5fa1f86286 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:08.193506 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2df844a6-a299-4550-84ee-8f5fa1f86286 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:08.193995 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2df844a6-a299-4550-84ee-8f5fa1f86286 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:08.194443 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2df844a6-a299-4550-84ee-8f5fa1f86286 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:08.195127 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2df844a6-a299-4550-84ee-8f5fa1f86286 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:08.195586 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2df844a6-a299-4550-84ee-8f5fa1f86286 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:08.196016 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2df844a6-a299-4550-84ee-8f5fa1f86286 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:08.240909 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-2df844a6-a299-4550-84ee-8f5fa1f86286 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120806) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 26 05:32:08.309973 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2df844a6-a299-4550-84ee-8f5fa1f86286 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "POST /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/action" status: 202 len: 0 microversion: 2.20 time: 0.126954 Sep 26 05:32:08.310551 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 217/417] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Sep 26 05:32:08 2022] POST /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:32:08.319542 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f8a3afb3-52f4-4f08-8862-d91dbc8703b5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:08.320162 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f8a3afb3-52f4-4f08-8862-d91dbc8703b5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:08.327254 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f8a3afb3-52f4-4f08-8862-d91dbc8703b5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:08.327848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f8a3afb3-52f4-4f08-8862-d91dbc8703b5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:08.328393 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f8a3afb3-52f4-4f08-8862-d91dbc8703b5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:08.329277 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f8a3afb3-52f4-4f08-8862-d91dbc8703b5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:08.329796 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f8a3afb3-52f4-4f08-8862-d91dbc8703b5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:08.330350 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f8a3afb3-52f4-4f08-8862-d91dbc8703b5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:08.473738 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f8a3afb3-52f4-4f08-8862-d91dbc8703b5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:08.482574 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f8a3afb3-52f4-4f08-8862-d91dbc8703b5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:08.484126 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f8a3afb3-52f4-4f08-8862-d91dbc8703b5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:08.485342 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f8a3afb3-52f4-4f08-8862-d91dbc8703b5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1810 microversion: 2.20 time: 0.170122 Sep 26 05:32:08.485895 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 201/418] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:08 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:32:08.737869 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a39973bd-f1ad-4b4c-9df7-3c61a8253c5b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:08.738732 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a39973bd-f1ad-4b4c-9df7-3c61a8253c5b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:08.745000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a39973bd-f1ad-4b4c-9df7-3c61a8253c5b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:08.745496 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a39973bd-f1ad-4b4c-9df7-3c61a8253c5b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:08.745935 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a39973bd-f1ad-4b4c-9df7-3c61a8253c5b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:08.746635 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a39973bd-f1ad-4b4c-9df7-3c61a8253c5b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:08.747086 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a39973bd-f1ad-4b4c-9df7-3c61a8253c5b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:08.747521 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a39973bd-f1ad-4b4c-9df7-3c61a8253c5b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:08.882668 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a39973bd-f1ad-4b4c-9df7-3c61a8253c5b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:08.890364 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a39973bd-f1ad-4b4c-9df7-3c61a8253c5b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.156665 Sep 26 05:32:08.890919 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 218/419] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:08 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:09.511647 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2b7ae2f2-999b-4fff-b5c0-883544ee1ffa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:09.512331 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2b7ae2f2-999b-4fff-b5c0-883544ee1ffa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:09.519482 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b7ae2f2-999b-4fff-b5c0-883544ee1ffa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:09.520794 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b7ae2f2-999b-4fff-b5c0-883544ee1ffa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:09.520794 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b7ae2f2-999b-4fff-b5c0-883544ee1ffa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:09.521176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b7ae2f2-999b-4fff-b5c0-883544ee1ffa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:09.521631 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b7ae2f2-999b-4fff-b5c0-883544ee1ffa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:09.522052 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b7ae2f2-999b-4fff-b5c0-883544ee1ffa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:09.661046 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2b7ae2f2-999b-4fff-b5c0-883544ee1ffa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:09.669815 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2b7ae2f2-999b-4fff-b5c0-883544ee1ffa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:09.671287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2b7ae2f2-999b-4fff-b5c0-883544ee1ffa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:09.672790 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2b7ae2f2-999b-4fff-b5c0-883544ee1ffa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1750 microversion: 2.20 time: 0.165017 Sep 26 05:32:09.673359 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 202/420] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:09 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:09.914498 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-03c1655a-9d25-425b-87cb-9663a780e656 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:09.915142 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-03c1655a-9d25-425b-87cb-9663a780e656 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:09.921290 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-03c1655a-9d25-425b-87cb-9663a780e656 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:09.921777 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-03c1655a-9d25-425b-87cb-9663a780e656 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:09.922215 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-03c1655a-9d25-425b-87cb-9663a780e656 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:09.922903 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-03c1655a-9d25-425b-87cb-9663a780e656 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:09.923357 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-03c1655a-9d25-425b-87cb-9663a780e656 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:09.923779 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-03c1655a-9d25-425b-87cb-9663a780e656 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:10.058808 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-03c1655a-9d25-425b-87cb-9663a780e656 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:10.066429 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-03c1655a-9d25-425b-87cb-9663a780e656 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.156462 Sep 26 05:32:10.066988 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 219/421] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:09 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:10.698836 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c0d4a1da-ba36-4f41-996f-6b897d83acec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:10.699444 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c0d4a1da-ba36-4f41-996f-6b897d83acec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:10.705818 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c0d4a1da-ba36-4f41-996f-6b897d83acec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:10.706300 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c0d4a1da-ba36-4f41-996f-6b897d83acec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:10.706748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c0d4a1da-ba36-4f41-996f-6b897d83acec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:10.708376 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c0d4a1da-ba36-4f41-996f-6b897d83acec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:10.708833 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c0d4a1da-ba36-4f41-996f-6b897d83acec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:10.709262 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c0d4a1da-ba36-4f41-996f-6b897d83acec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:10.841589 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c0d4a1da-ba36-4f41-996f-6b897d83acec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:10.850703 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c0d4a1da-ba36-4f41-996f-6b897d83acec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:10.852313 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c0d4a1da-ba36-4f41-996f-6b897d83acec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:10.853468 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c0d4a1da-ba36-4f41-996f-6b897d83acec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1752 microversion: 2.20 time: 0.158590 Sep 26 05:32:10.854025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 203/422] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:10 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:32:11.089135 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5ce34f92-af4b-4b96-bdcd-28d58d125339 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:11.089745 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5ce34f92-af4b-4b96-bdcd-28d58d125339 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:11.096389 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ce34f92-af4b-4b96-bdcd-28d58d125339 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:11.096876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ce34f92-af4b-4b96-bdcd-28d58d125339 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:11.097309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ce34f92-af4b-4b96-bdcd-28d58d125339 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:11.098639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ce34f92-af4b-4b96-bdcd-28d58d125339 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:11.099257 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ce34f92-af4b-4b96-bdcd-28d58d125339 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:11.099845 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ce34f92-af4b-4b96-bdcd-28d58d125339 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:11.252668 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5ce34f92-af4b-4b96-bdcd-28d58d125339 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:11.260946 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5ce34f92-af4b-4b96-bdcd-28d58d125339 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1372 microversion: 2.1 time: 0.175673 Sep 26 05:32:11.261527 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 220/423] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:11 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:11.327217 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ad8b25ff-9a69-4b6f-bc0b-e34e2f61b909 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:11.327729 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ad8b25ff-9a69-4b6f-bc0b-e34e2f61b909 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:11.334232 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ad8b25ff-9a69-4b6f-bc0b-e34e2f61b909 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:11.334723 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ad8b25ff-9a69-4b6f-bc0b-e34e2f61b909 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:11.335161 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ad8b25ff-9a69-4b6f-bc0b-e34e2f61b909 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:11.335863 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ad8b25ff-9a69-4b6f-bc0b-e34e2f61b909 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:11.336347 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ad8b25ff-9a69-4b6f-bc0b-e34e2f61b909 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:11.336780 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ad8b25ff-9a69-4b6f-bc0b-e34e2f61b909 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:11.471066 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-ad8b25ff-9a69-4b6f-bc0b-e34e2f61b909 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lazy-loading 'services' on Instance uuid 7efac409-bfde-4b69-a933-f76bf0442c1b {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:32:11.590535 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ad8b25ff-9a69-4b6f-bc0b-e34e2f61b909 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b/os-volume_attachments/063fd65b-f5ce-408e-b392-b992ee4aa112" status: 202 len: 0 microversion: 2.1 time: 0.267148 Sep 26 05:32:11.591108 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 204/424] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 05:32:11 2022] DELETE /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b/os-volume_attachments/063fd65b-f5ce-408e-b392-b992ee4aa112 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 05:32:11.878825 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-aa1c9bec-c0b7-491c-af32-fb61b1c67d05 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:11.879646 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-aa1c9bec-c0b7-491c-af32-fb61b1c67d05 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:11.885569 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-aa1c9bec-c0b7-491c-af32-fb61b1c67d05 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:11.886053 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-aa1c9bec-c0b7-491c-af32-fb61b1c67d05 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:11.886493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-aa1c9bec-c0b7-491c-af32-fb61b1c67d05 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:11.887176 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-aa1c9bec-c0b7-491c-af32-fb61b1c67d05 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:11.887630 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-aa1c9bec-c0b7-491c-af32-fb61b1c67d05 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:11.888050 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-aa1c9bec-c0b7-491c-af32-fb61b1c67d05 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:12.016394 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-aa1c9bec-c0b7-491c-af32-fb61b1c67d05 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:12.019790 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:12.025861 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-aa1c9bec-c0b7-491c-af32-fb61b1c67d05 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:12.027296 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-aa1c9bec-c0b7-491c-af32-fb61b1c67d05 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:12.028482 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-aa1c9bec-c0b7-491c-af32-fb61b1c67d05 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.153567 Sep 26 05:32:12.029025 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 221/425] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:11 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:12.284646 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-13130093-e5b9-4868-86e9-03ce42ea76b3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:12.286140 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-13130093-e5b9-4868-86e9-03ce42ea76b3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:12.292872 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-13130093-e5b9-4868-86e9-03ce42ea76b3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:12.293357 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-13130093-e5b9-4868-86e9-03ce42ea76b3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:12.293796 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-13130093-e5b9-4868-86e9-03ce42ea76b3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:12.294492 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-13130093-e5b9-4868-86e9-03ce42ea76b3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:12.294949 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-13130093-e5b9-4868-86e9-03ce42ea76b3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:12.295374 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-13130093-e5b9-4868-86e9-03ce42ea76b3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:12.427567 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-13130093-e5b9-4868-86e9-03ce42ea76b3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:12.435407 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-13130093-e5b9-4868-86e9-03ce42ea76b3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1566 microversion: 2.1 time: 0.155112 Sep 26 05:32:12.435950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 205/426] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:12 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:12.458432 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3a439719-8af2-4b63-917a-9b80cff04abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:12.458969 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-3a439719-8af2-4b63-917a-9b80cff04abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:12.465442 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3a439719-8af2-4b63-917a-9b80cff04abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:12.465916 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3a439719-8af2-4b63-917a-9b80cff04abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:12.466343 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3a439719-8af2-4b63-917a-9b80cff04abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:12.467019 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3a439719-8af2-4b63-917a-9b80cff04abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:12.467463 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3a439719-8af2-4b63-917a-9b80cff04abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:12.467879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3a439719-8af2-4b63-917a-9b80cff04abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:12.545756 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-3a439719-8af2-4b63-917a-9b80cff04abc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091630 Sep 26 05:32:12.546339 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 222/427] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 05:32:12 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:32:13.054733 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0d95404c-2c4b-422c-86f8-4e3ddee99038 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:13.055490 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0d95404c-2c4b-422c-86f8-4e3ddee99038 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:13.061403 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0d95404c-2c4b-422c-86f8-4e3ddee99038 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:13.061981 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0d95404c-2c4b-422c-86f8-4e3ddee99038 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:13.062486 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0d95404c-2c4b-422c-86f8-4e3ddee99038 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:13.063241 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0d95404c-2c4b-422c-86f8-4e3ddee99038 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:13.063764 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0d95404c-2c4b-422c-86f8-4e3ddee99038 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:13.064269 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0d95404c-2c4b-422c-86f8-4e3ddee99038 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:13.369770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0d95404c-2c4b-422c-86f8-4e3ddee99038 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:13.378373 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0d95404c-2c4b-422c-86f8-4e3ddee99038 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:13.380439 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0d95404c-2c4b-422c-86f8-4e3ddee99038 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:13.381683 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0d95404c-2c4b-422c-86f8-4e3ddee99038 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.330984 Sep 26 05:32:13.382269 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 206/428] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:13 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:13.777474 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e24de91d-c4e3-45a4-b232-0069cabd177c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:13.777989 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e24de91d-c4e3-45a4-b232-0069cabd177c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:13.783827 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e24de91d-c4e3-45a4-b232-0069cabd177c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:13.784340 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e24de91d-c4e3-45a4-b232-0069cabd177c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:13.784779 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e24de91d-c4e3-45a4-b232-0069cabd177c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:13.785480 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e24de91d-c4e3-45a4-b232-0069cabd177c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:13.786047 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e24de91d-c4e3-45a4-b232-0069cabd177c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:13.786475 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e24de91d-c4e3-45a4-b232-0069cabd177c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:13.811635 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e24de91d-c4e3-45a4-b232-0069cabd177c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Going to try to terminate instance {{(pid=120806) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:32:13.903189 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e24de91d-c4e3-45a4-b232-0069cabd177c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 204 len: 0 microversion: 2.1 time: 0.129179 Sep 26 05:32:13.904769 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 223/429] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:32:13 2022] DELETE /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:32:13.912866 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-47f34054-60b5-4239-9749-810baf39be8b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:13.913512 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-47f34054-60b5-4239-9749-810baf39be8b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:13.919547 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-47f34054-60b5-4239-9749-810baf39be8b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:13.920109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-47f34054-60b5-4239-9749-810baf39be8b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:13.920786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-47f34054-60b5-4239-9749-810baf39be8b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:13.921662 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-47f34054-60b5-4239-9749-810baf39be8b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:13.922341 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-47f34054-60b5-4239-9749-810baf39be8b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:13.922828 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-47f34054-60b5-4239-9749-810baf39be8b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:13.945120 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-130396f1-b2a8-4eda-9c3f-fcde21c3f6d5 req-7b6fe98a-d447-4f2f-9419-ae214d6c7e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c51093-517b-4a33-9d80-8bf0e1747e75", "tag": "322798b9-1af9-46df-bb99-417d8b1d04b3"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:32:13.958898 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-130396f1-b2a8-4eda-9c3f-fcde21c3f6d5 req-7b6fe98a-d447-4f2f-9419-ae214d6c7e4f service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:13.959955 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-130396f1-b2a8-4eda-9c3f-fcde21c3f6d5 req-7b6fe98a-d447-4f2f-9419-ae214d6c7e4f service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:13.960685 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-130396f1-b2a8-4eda-9c3f-fcde21c3f6d5 req-7b6fe98a-d447-4f2f-9419-ae214d6c7e4f service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:13.975191 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-130396f1-b2a8-4eda-9c3f-fcde21c3f6d5 req-7b6fe98a-d447-4f2f-9419-ae214d6c7e4f service nova] Creating event network-changed:322798b9-1af9-46df-bb99-417d8b1d04b3 for instance 30c51093-517b-4a33-9d80-8bf0e1747e75 on hv-cinder-85918 Sep 26 05:32:13.980938 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-130396f1-b2a8-4eda-9c3f-fcde21c3f6d5 req-7b6fe98a-d447-4f2f-9419-ae214d6c7e4f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041968 Sep 26 05:32:13.982011 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 224/430] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:32:14.077538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-47f34054-60b5-4239-9749-810baf39be8b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:14.085568 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-47f34054-60b5-4239-9749-810baf39be8b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.176531 Sep 26 05:32:14.086140 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 207/431] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:13 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:14.408671 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-69a38d3e-34d6-4561-ba76-cd310af52ca0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:14.409403 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-69a38d3e-34d6-4561-ba76-cd310af52ca0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:14.415957 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-69a38d3e-34d6-4561-ba76-cd310af52ca0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:14.416483 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-69a38d3e-34d6-4561-ba76-cd310af52ca0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:14.416924 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-69a38d3e-34d6-4561-ba76-cd310af52ca0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:14.417617 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-69a38d3e-34d6-4561-ba76-cd310af52ca0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:14.418075 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-69a38d3e-34d6-4561-ba76-cd310af52ca0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:14.418500 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-69a38d3e-34d6-4561-ba76-cd310af52ca0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:14.547836 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-69a38d3e-34d6-4561-ba76-cd310af52ca0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:14.556793 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-69a38d3e-34d6-4561-ba76-cd310af52ca0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:14.558252 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-69a38d3e-34d6-4561-ba76-cd310af52ca0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:14.559436 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-69a38d3e-34d6-4561-ba76-cd310af52ca0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.155175 Sep 26 05:32:14.559996 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 225/432] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:14 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:32:15.109543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cb06b099-2641-4679-80f9-48b1bb8b69ac tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:15.110183 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cb06b099-2641-4679-80f9-48b1bb8b69ac tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:15.116852 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb06b099-2641-4679-80f9-48b1bb8b69ac tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:15.117334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb06b099-2641-4679-80f9-48b1bb8b69ac tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:15.117768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb06b099-2641-4679-80f9-48b1bb8b69ac tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:15.118559 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb06b099-2641-4679-80f9-48b1bb8b69ac tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:15.118987 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb06b099-2641-4679-80f9-48b1bb8b69ac tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:15.119407 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb06b099-2641-4679-80f9-48b1bb8b69ac tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:15.252573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cb06b099-2641-4679-80f9-48b1bb8b69ac tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:15.260857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cb06b099-2641-4679-80f9-48b1bb8b69ac tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.155502 Sep 26 05:32:15.261423 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 208/433] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:15 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:32:15.584078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-25227406-439b-423d-9213-f63a4e5a3e66 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:15.584703 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-25227406-439b-423d-9213-f63a4e5a3e66 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:15.590721 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-25227406-439b-423d-9213-f63a4e5a3e66 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:15.591197 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-25227406-439b-423d-9213-f63a4e5a3e66 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:15.591627 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-25227406-439b-423d-9213-f63a4e5a3e66 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:15.592329 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-25227406-439b-423d-9213-f63a4e5a3e66 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:15.592778 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-25227406-439b-423d-9213-f63a4e5a3e66 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:15.593196 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-25227406-439b-423d-9213-f63a4e5a3e66 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:15.718005 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-25227406-439b-423d-9213-f63a4e5a3e66 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:15.726934 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-25227406-439b-423d-9213-f63a4e5a3e66 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:15.728391 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-25227406-439b-423d-9213-f63a4e5a3e66 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:15.729533 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-25227406-439b-423d-9213-f63a4e5a3e66 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.149473 Sep 26 05:32:15.730075 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 226/434] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:15 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:16.283994 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b41dc01a-3e04-41a5-b2dc-27896e02b4b2 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:16.284731 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b41dc01a-3e04-41a5-b2dc-27896e02b4b2 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:16.292072 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b41dc01a-3e04-41a5-b2dc-27896e02b4b2 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:16.292515 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b41dc01a-3e04-41a5-b2dc-27896e02b4b2 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:16.292949 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b41dc01a-3e04-41a5-b2dc-27896e02b4b2 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:16.293641 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b41dc01a-3e04-41a5-b2dc-27896e02b4b2 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:16.294093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b41dc01a-3e04-41a5-b2dc-27896e02b4b2 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:16.294513 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b41dc01a-3e04-41a5-b2dc-27896e02b4b2 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:16.426973 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b41dc01a-3e04-41a5-b2dc-27896e02b4b2 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:16.435017 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b41dc01a-3e04-41a5-b2dc-27896e02b4b2 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.154862 Sep 26 05:32:16.435847 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 209/435] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:16 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:16.756155 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-8f1c22fe-5e12-4f00-8349-b7e42a75d1a7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:16.756799 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-8f1c22fe-5e12-4f00-8349-b7e42a75d1a7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:16.762734 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8f1c22fe-5e12-4f00-8349-b7e42a75d1a7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:16.763218 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8f1c22fe-5e12-4f00-8349-b7e42a75d1a7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:16.763653 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8f1c22fe-5e12-4f00-8349-b7e42a75d1a7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:16.764378 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8f1c22fe-5e12-4f00-8349-b7e42a75d1a7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:16.764837 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8f1c22fe-5e12-4f00-8349-b7e42a75d1a7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:16.765260 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8f1c22fe-5e12-4f00-8349-b7e42a75d1a7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:16.892865 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8f1c22fe-5e12-4f00-8349-b7e42a75d1a7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:16.901616 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8f1c22fe-5e12-4f00-8349-b7e42a75d1a7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:16.903043 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8f1c22fe-5e12-4f00-8349-b7e42a75d1a7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:16.904338 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-8f1c22fe-5e12-4f00-8349-b7e42a75d1a7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.153028 Sep 26 05:32:16.904893 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 227/436] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:16 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:17.459630 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c7a9b6ee-a901-4b97-ab4c-fcf166f3cc2c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:17.460880 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c7a9b6ee-a901-4b97-ab4c-fcf166f3cc2c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:17.467785 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c7a9b6ee-a901-4b97-ab4c-fcf166f3cc2c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:17.468534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c7a9b6ee-a901-4b97-ab4c-fcf166f3cc2c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:17.468966 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c7a9b6ee-a901-4b97-ab4c-fcf166f3cc2c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:17.469666 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c7a9b6ee-a901-4b97-ab4c-fcf166f3cc2c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:17.470913 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c7a9b6ee-a901-4b97-ab4c-fcf166f3cc2c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:17.471409 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c7a9b6ee-a901-4b97-ab4c-fcf166f3cc2c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:17.890351 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c7a9b6ee-a901-4b97-ab4c-fcf166f3cc2c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:17.903047 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c7a9b6ee-a901-4b97-ab4c-fcf166f3cc2c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.447845 Sep 26 05:32:17.904967 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 210/437] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:17 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:17.930696 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-30198d79-3689-4e83-991e-56fdf562f738 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:17.931245 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-30198d79-3689-4e83-991e-56fdf562f738 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:17.939426 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-30198d79-3689-4e83-991e-56fdf562f738 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:17.939927 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-30198d79-3689-4e83-991e-56fdf562f738 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:17.940370 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-30198d79-3689-4e83-991e-56fdf562f738 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:17.941152 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-30198d79-3689-4e83-991e-56fdf562f738 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:17.941803 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-30198d79-3689-4e83-991e-56fdf562f738 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:17.942242 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-30198d79-3689-4e83-991e-56fdf562f738 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:18.121350 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-30198d79-3689-4e83-991e-56fdf562f738 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:18.130176 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-30198d79-3689-4e83-991e-56fdf562f738 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:18.131874 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-30198d79-3689-4e83-991e-56fdf562f738 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:18.133564 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-30198d79-3689-4e83-991e-56fdf562f738 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.206725 Sep 26 05:32:18.134267 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 228/438] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:17 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:18.928341 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cbe7c269-3fbb-4c24-928e-cc26cb21a201 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:18.928962 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cbe7c269-3fbb-4c24-928e-cc26cb21a201 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:18.935441 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cbe7c269-3fbb-4c24-928e-cc26cb21a201 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:18.935926 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cbe7c269-3fbb-4c24-928e-cc26cb21a201 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:18.936394 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cbe7c269-3fbb-4c24-928e-cc26cb21a201 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:18.937084 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cbe7c269-3fbb-4c24-928e-cc26cb21a201 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:18.937539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cbe7c269-3fbb-4c24-928e-cc26cb21a201 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:18.937962 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cbe7c269-3fbb-4c24-928e-cc26cb21a201 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:19.079239 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cbe7c269-3fbb-4c24-928e-cc26cb21a201 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:19.087613 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cbe7c269-3fbb-4c24-928e-cc26cb21a201 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.163977 Sep 26 05:32:19.088183 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 211/439] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:18 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:19.160451 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-287a9f42-fd5d-4b09-b091-1237c1fd41d6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:19.161746 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-287a9f42-fd5d-4b09-b091-1237c1fd41d6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:19.167580 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-287a9f42-fd5d-4b09-b091-1237c1fd41d6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:19.168056 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-287a9f42-fd5d-4b09-b091-1237c1fd41d6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:19.168622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-287a9f42-fd5d-4b09-b091-1237c1fd41d6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:19.169297 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-287a9f42-fd5d-4b09-b091-1237c1fd41d6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:19.169742 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-287a9f42-fd5d-4b09-b091-1237c1fd41d6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:19.170241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-287a9f42-fd5d-4b09-b091-1237c1fd41d6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:19.320856 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-287a9f42-fd5d-4b09-b091-1237c1fd41d6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:19.329452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-287a9f42-fd5d-4b09-b091-1237c1fd41d6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:19.330904 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-287a9f42-fd5d-4b09-b091-1237c1fd41d6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:19.332057 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-287a9f42-fd5d-4b09-b091-1237c1fd41d6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.175510 Sep 26 05:32:19.332683 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 229/440] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:19 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:20.111615 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6e6b6396-cd59-40e4-98e4-92ba0cbc23e1 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:20.112237 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6e6b6396-cd59-40e4-98e4-92ba0cbc23e1 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:20.119619 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6e6b6396-cd59-40e4-98e4-92ba0cbc23e1 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:20.120042 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6e6b6396-cd59-40e4-98e4-92ba0cbc23e1 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:20.120510 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6e6b6396-cd59-40e4-98e4-92ba0cbc23e1 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:20.121197 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6e6b6396-cd59-40e4-98e4-92ba0cbc23e1 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:20.121649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6e6b6396-cd59-40e4-98e4-92ba0cbc23e1 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:20.122075 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6e6b6396-cd59-40e4-98e4-92ba0cbc23e1 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:20.249903 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6e6b6396-cd59-40e4-98e4-92ba0cbc23e1 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:20.258109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6e6b6396-cd59-40e4-98e4-92ba0cbc23e1 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.150325 Sep 26 05:32:20.258666 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 212/441] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:20 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:32:20.358403 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-47338fb4-93b8-45ba-80b6-26a0a371d2cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:20.359014 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-47338fb4-93b8-45ba-80b6-26a0a371d2cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:20.365194 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-47338fb4-93b8-45ba-80b6-26a0a371d2cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:20.365729 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-47338fb4-93b8-45ba-80b6-26a0a371d2cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:20.366167 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-47338fb4-93b8-45ba-80b6-26a0a371d2cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:20.366865 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-47338fb4-93b8-45ba-80b6-26a0a371d2cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:20.367318 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-47338fb4-93b8-45ba-80b6-26a0a371d2cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:20.367741 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-47338fb4-93b8-45ba-80b6-26a0a371d2cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:20.496445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-47338fb4-93b8-45ba-80b6-26a0a371d2cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:20.505574 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-47338fb4-93b8-45ba-80b6-26a0a371d2cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:20.507014 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-47338fb4-93b8-45ba-80b6-26a0a371d2cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:20.508163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-47338fb4-93b8-45ba-80b6-26a0a371d2cc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.153974 Sep 26 05:32:20.508761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 230/442] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:20 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:21.282057 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-81b565a2-792e-4bc3-84e7-de6b55c7cd62 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:21.282674 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-81b565a2-792e-4bc3-84e7-de6b55c7cd62 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:21.290211 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81b565a2-792e-4bc3-84e7-de6b55c7cd62 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:21.290702 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81b565a2-792e-4bc3-84e7-de6b55c7cd62 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:21.291140 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81b565a2-792e-4bc3-84e7-de6b55c7cd62 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:21.291842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81b565a2-792e-4bc3-84e7-de6b55c7cd62 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:21.292320 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81b565a2-792e-4bc3-84e7-de6b55c7cd62 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:21.292747 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81b565a2-792e-4bc3-84e7-de6b55c7cd62 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:21.372302 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-7af8cdaa-4350-4ce5-9a09-517d2ea3a6fd req-7a31fcee-1e22-45ed-b14a-4e7bd34a2f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7efac409-bfde-4b69-a933-f76bf0442c1b", "name": "network-vif-unplugged", "status": "completed", "tag": "48afb2fc-5507-40ee-ac44-fdd6ed4af3d2"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:32:21.384316 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-7af8cdaa-4350-4ce5-9a09-517d2ea3a6fd req-7a31fcee-1e22-45ed-b14a-4e7bd34a2f10 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:21.384798 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-7af8cdaa-4350-4ce5-9a09-517d2ea3a6fd req-7a31fcee-1e22-45ed-b14a-4e7bd34a2f10 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:21.385226 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-7af8cdaa-4350-4ce5-9a09-517d2ea3a6fd req-7a31fcee-1e22-45ed-b14a-4e7bd34a2f10 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:21.399441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-7af8cdaa-4350-4ce5-9a09-517d2ea3a6fd req-7a31fcee-1e22-45ed-b14a-4e7bd34a2f10 service nova] Creating event network-vif-unplugged:48afb2fc-5507-40ee-ac44-fdd6ed4af3d2 for instance 7efac409-bfde-4b69-a933-f76bf0442c1b on hv-cinder-85918 Sep 26 05:32:21.404614 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-7af8cdaa-4350-4ce5-9a09-517d2ea3a6fd req-7a31fcee-1e22-45ed-b14a-4e7bd34a2f10 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036127 Sep 26 05:32:21.405218 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 231/443] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:32:21.444869 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-81b565a2-792e-4bc3-84e7-de6b55c7cd62 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:21.454913 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-81b565a2-792e-4bc3-84e7-de6b55c7cd62 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.176644 Sep 26 05:32:21.456080 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 213/444] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:21 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:21.534337 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-acc1ded4-5733-4f15-8195-56996583e22a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:21.534943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-acc1ded4-5733-4f15-8195-56996583e22a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:21.542160 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-acc1ded4-5733-4f15-8195-56996583e22a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:21.542650 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-acc1ded4-5733-4f15-8195-56996583e22a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:21.543089 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-acc1ded4-5733-4f15-8195-56996583e22a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:21.543785 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-acc1ded4-5733-4f15-8195-56996583e22a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:21.544237 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-acc1ded4-5733-4f15-8195-56996583e22a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:21.544695 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-acc1ded4-5733-4f15-8195-56996583e22a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:21.675396 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-acc1ded4-5733-4f15-8195-56996583e22a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:21.685386 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-acc1ded4-5733-4f15-8195-56996583e22a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:21.686829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-acc1ded4-5733-4f15-8195-56996583e22a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:21.688012 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-acc1ded4-5733-4f15-8195-56996583e22a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.157978 Sep 26 05:32:21.688591 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 232/445] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:21 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:22.479454 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-419080fd-9727-445d-b61c-3bcd16723d6a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:22.480098 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-419080fd-9727-445d-b61c-3bcd16723d6a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:22.486749 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-419080fd-9727-445d-b61c-3bcd16723d6a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:22.487222 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-419080fd-9727-445d-b61c-3bcd16723d6a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:22.487651 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-419080fd-9727-445d-b61c-3bcd16723d6a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:22.488357 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-419080fd-9727-445d-b61c-3bcd16723d6a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:22.488804 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-419080fd-9727-445d-b61c-3bcd16723d6a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:22.489221 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-419080fd-9727-445d-b61c-3bcd16723d6a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:22.621102 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-419080fd-9727-445d-b61c-3bcd16723d6a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:22.623402 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:22.630738 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-419080fd-9727-445d-b61c-3bcd16723d6a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.155094 Sep 26 05:32:22.631299 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 214/446] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:22 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:22.716922 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-2233b740-efce-40fc-89a1-55350fd1d0d5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:22.718529 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-2233b740-efce-40fc-89a1-55350fd1d0d5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:22.726382 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2233b740-efce-40fc-89a1-55350fd1d0d5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:22.726874 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2233b740-efce-40fc-89a1-55350fd1d0d5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:22.727308 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2233b740-efce-40fc-89a1-55350fd1d0d5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:22.728016 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2233b740-efce-40fc-89a1-55350fd1d0d5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:22.728495 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2233b740-efce-40fc-89a1-55350fd1d0d5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:22.728924 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2233b740-efce-40fc-89a1-55350fd1d0d5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:22.882693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2233b740-efce-40fc-89a1-55350fd1d0d5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:22.891334 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2233b740-efce-40fc-89a1-55350fd1d0d5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:22.892829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2233b740-efce-40fc-89a1-55350fd1d0d5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:22.893989 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2233b740-efce-40fc-89a1-55350fd1d0d5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.183571 Sep 26 05:32:22.894541 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 233/447] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:22 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:23.655287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b75d3fcd-3547-461a-845f-d4552885e94f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:23.655929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b75d3fcd-3547-461a-845f-d4552885e94f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:23.664488 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b75d3fcd-3547-461a-845f-d4552885e94f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:23.664976 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b75d3fcd-3547-461a-845f-d4552885e94f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:23.665417 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b75d3fcd-3547-461a-845f-d4552885e94f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:23.666110 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b75d3fcd-3547-461a-845f-d4552885e94f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:23.666575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b75d3fcd-3547-461a-845f-d4552885e94f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:23.667005 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b75d3fcd-3547-461a-845f-d4552885e94f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:23.817481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b75d3fcd-3547-461a-845f-d4552885e94f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:23.825146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b75d3fcd-3547-461a-845f-d4552885e94f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.174545 Sep 26 05:32:23.825714 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 215/448] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:23 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:23.918999 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-21734dc9-9851-48cd-a606-de3061a0a687 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:23.919674 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-21734dc9-9851-48cd-a606-de3061a0a687 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:23.925707 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-21734dc9-9851-48cd-a606-de3061a0a687 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:23.926188 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-21734dc9-9851-48cd-a606-de3061a0a687 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:23.926617 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-21734dc9-9851-48cd-a606-de3061a0a687 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:23.927307 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-21734dc9-9851-48cd-a606-de3061a0a687 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:23.927755 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-21734dc9-9851-48cd-a606-de3061a0a687 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:23.928177 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-21734dc9-9851-48cd-a606-de3061a0a687 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:24.065104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-21734dc9-9851-48cd-a606-de3061a0a687 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:24.074351 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-21734dc9-9851-48cd-a606-de3061a0a687 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:24.075798 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-21734dc9-9851-48cd-a606-de3061a0a687 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:24.077020 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-21734dc9-9851-48cd-a606-de3061a0a687 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.161950 Sep 26 05:32:24.077629 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 234/449] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:23 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:24.849450 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-476c6b00-eacc-4141-ac86-587f60132ed4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:24.850068 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-476c6b00-eacc-4141-ac86-587f60132ed4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:24.856962 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-476c6b00-eacc-4141-ac86-587f60132ed4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:24.857441 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-476c6b00-eacc-4141-ac86-587f60132ed4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:24.857873 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-476c6b00-eacc-4141-ac86-587f60132ed4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:24.858551 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-476c6b00-eacc-4141-ac86-587f60132ed4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:24.859001 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-476c6b00-eacc-4141-ac86-587f60132ed4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:24.859423 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-476c6b00-eacc-4141-ac86-587f60132ed4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:24.987737 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-476c6b00-eacc-4141-ac86-587f60132ed4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:24.995444 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-476c6b00-eacc-4141-ac86-587f60132ed4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.150329 Sep 26 05:32:24.996010 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 216/450] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:24 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:25.103577 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-20015db4-5288-4453-b87f-326d376dc172 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:25.105323 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-20015db4-5288-4453-b87f-326d376dc172 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:25.112138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20015db4-5288-4453-b87f-326d376dc172 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:25.112651 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20015db4-5288-4453-b87f-326d376dc172 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:25.113080 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20015db4-5288-4453-b87f-326d376dc172 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:25.113774 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20015db4-5288-4453-b87f-326d376dc172 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:25.114250 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20015db4-5288-4453-b87f-326d376dc172 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:25.114675 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20015db4-5288-4453-b87f-326d376dc172 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:25.248909 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-20015db4-5288-4453-b87f-326d376dc172 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:25.258562 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-20015db4-5288-4453-b87f-326d376dc172 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:25.260311 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-20015db4-5288-4453-b87f-326d376dc172 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:25.261687 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-20015db4-5288-4453-b87f-326d376dc172 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.162120 Sep 26 05:32:25.276008 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 235/451] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:25 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:26.018468 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6735f557-dbf8-4275-82de-9e3299c6bd5c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:26.019102 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6735f557-dbf8-4275-82de-9e3299c6bd5c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:26.025414 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6735f557-dbf8-4275-82de-9e3299c6bd5c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:26.025901 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6735f557-dbf8-4275-82de-9e3299c6bd5c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:26.026342 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6735f557-dbf8-4275-82de-9e3299c6bd5c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:26.027035 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6735f557-dbf8-4275-82de-9e3299c6bd5c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:26.027498 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6735f557-dbf8-4275-82de-9e3299c6bd5c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:26.027926 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6735f557-dbf8-4275-82de-9e3299c6bd5c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:26.167380 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6735f557-dbf8-4275-82de-9e3299c6bd5c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:26.174987 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6735f557-dbf8-4275-82de-9e3299c6bd5c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.160403 Sep 26 05:32:26.175548 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 217/452] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:26 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:26.288370 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-fba5bea0-f696-45d1-910b-1d623f817332 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:26.289120 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-fba5bea0-f696-45d1-910b-1d623f817332 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:26.295729 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fba5bea0-f696-45d1-910b-1d623f817332 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:26.296244 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fba5bea0-f696-45d1-910b-1d623f817332 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:26.296694 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fba5bea0-f696-45d1-910b-1d623f817332 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:26.297379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fba5bea0-f696-45d1-910b-1d623f817332 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:26.297823 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fba5bea0-f696-45d1-910b-1d623f817332 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:26.298244 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fba5bea0-f696-45d1-910b-1d623f817332 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:26.436941 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-fba5bea0-f696-45d1-910b-1d623f817332 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:26.445844 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-fba5bea0-f696-45d1-910b-1d623f817332 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:26.447392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-fba5bea0-f696-45d1-910b-1d623f817332 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:26.448577 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-fba5bea0-f696-45d1-910b-1d623f817332 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.164973 Sep 26 05:32:26.449135 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 236/453] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:26 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:27.200657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d8f17cec-3807-4249-9eaf-f3168bb39bcd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:27.202268 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d8f17cec-3807-4249-9eaf-f3168bb39bcd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:27.211321 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d8f17cec-3807-4249-9eaf-f3168bb39bcd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:27.212144 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d8f17cec-3807-4249-9eaf-f3168bb39bcd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:27.212923 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d8f17cec-3807-4249-9eaf-f3168bb39bcd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:27.213942 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d8f17cec-3807-4249-9eaf-f3168bb39bcd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:27.214343 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d8f17cec-3807-4249-9eaf-f3168bb39bcd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:27.214764 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d8f17cec-3807-4249-9eaf-f3168bb39bcd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:27.349250 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d8f17cec-3807-4249-9eaf-f3168bb39bcd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:27.357156 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d8f17cec-3807-4249-9eaf-f3168bb39bcd tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.162304 Sep 26 05:32:27.357721 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 218/454] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:27 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:27.474539 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1accc0f3-b037-456d-812f-3116d0be16cb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:27.475181 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-1accc0f3-b037-456d-812f-3116d0be16cb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:27.481429 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1accc0f3-b037-456d-812f-3116d0be16cb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:27.481912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1accc0f3-b037-456d-812f-3116d0be16cb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:27.482345 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1accc0f3-b037-456d-812f-3116d0be16cb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:27.483026 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1accc0f3-b037-456d-812f-3116d0be16cb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:27.483473 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1accc0f3-b037-456d-812f-3116d0be16cb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:27.483897 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1accc0f3-b037-456d-812f-3116d0be16cb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:27.612439 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1accc0f3-b037-456d-812f-3116d0be16cb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:27.621651 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1accc0f3-b037-456d-812f-3116d0be16cb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:27.623217 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1accc0f3-b037-456d-812f-3116d0be16cb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:27.624482 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1accc0f3-b037-456d-812f-3116d0be16cb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.153857 Sep 26 05:32:27.625067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 237/455] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:27 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:28.380219 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a7fc93aa-f756-4a3a-be29-b05f15068441 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:28.380786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a7fc93aa-f756-4a3a-be29-b05f15068441 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:28.387199 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7fc93aa-f756-4a3a-be29-b05f15068441 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:28.387689 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7fc93aa-f756-4a3a-be29-b05f15068441 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:28.388128 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7fc93aa-f756-4a3a-be29-b05f15068441 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:28.388988 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7fc93aa-f756-4a3a-be29-b05f15068441 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:28.389447 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7fc93aa-f756-4a3a-be29-b05f15068441 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:28.389875 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7fc93aa-f756-4a3a-be29-b05f15068441 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:28.524650 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a7fc93aa-f756-4a3a-be29-b05f15068441 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:28.533119 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a7fc93aa-f756-4a3a-be29-b05f15068441 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.157401 Sep 26 05:32:28.534331 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 219/456] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:28 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:28.651149 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-8a3d217f-2b4d-46c9-b757-e411b4d129a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:28.652022 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-8a3d217f-2b4d-46c9-b757-e411b4d129a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:28.658385 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8a3d217f-2b4d-46c9-b757-e411b4d129a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:28.658874 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8a3d217f-2b4d-46c9-b757-e411b4d129a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:28.659312 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8a3d217f-2b4d-46c9-b757-e411b4d129a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:28.660010 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8a3d217f-2b4d-46c9-b757-e411b4d129a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:28.660526 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8a3d217f-2b4d-46c9-b757-e411b4d129a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:28.661216 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8a3d217f-2b4d-46c9-b757-e411b4d129a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:28.684209 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:28.795289 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8a3d217f-2b4d-46c9-b757-e411b4d129a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:28.804412 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8a3d217f-2b4d-46c9-b757-e411b4d129a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:28.805849 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8a3d217f-2b4d-46c9-b757-e411b4d129a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:28.806988 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-8a3d217f-2b4d-46c9-b757-e411b4d129a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.159879 Sep 26 05:32:28.807540 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 238/457] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:28 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:29.557357 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-402b56dd-a7fa-470a-93d2-5dc65973273b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:29.557969 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-402b56dd-a7fa-470a-93d2-5dc65973273b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:29.564400 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-402b56dd-a7fa-470a-93d2-5dc65973273b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:29.564882 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-402b56dd-a7fa-470a-93d2-5dc65973273b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:29.565320 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-402b56dd-a7fa-470a-93d2-5dc65973273b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:29.566001 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-402b56dd-a7fa-470a-93d2-5dc65973273b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:29.566454 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-402b56dd-a7fa-470a-93d2-5dc65973273b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:29.567038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-402b56dd-a7fa-470a-93d2-5dc65973273b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:29.700065 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-402b56dd-a7fa-470a-93d2-5dc65973273b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:29.708833 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-402b56dd-a7fa-470a-93d2-5dc65973273b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.155272 Sep 26 05:32:29.709408 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 220/458] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:29 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:32:29.833780 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5ef28c20-8141-456e-84ea-b28f25903461 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:29.834346 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5ef28c20-8141-456e-84ea-b28f25903461 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:29.840222 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ef28c20-8141-456e-84ea-b28f25903461 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:29.840724 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ef28c20-8141-456e-84ea-b28f25903461 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:29.841151 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ef28c20-8141-456e-84ea-b28f25903461 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:29.841827 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ef28c20-8141-456e-84ea-b28f25903461 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:29.842271 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ef28c20-8141-456e-84ea-b28f25903461 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:29.842715 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ef28c20-8141-456e-84ea-b28f25903461 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:29.985854 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5ef28c20-8141-456e-84ea-b28f25903461 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:29.994639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5ef28c20-8141-456e-84ea-b28f25903461 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:29.996097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5ef28c20-8141-456e-84ea-b28f25903461 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:29.997301 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5ef28c20-8141-456e-84ea-b28f25903461 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.168316 Sep 26 05:32:29.997855 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 239/459] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:29 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:30.733552 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-83e3e39b-5132-4089-aca6-3020d2da4767 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:30.734191 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-83e3e39b-5132-4089-aca6-3020d2da4767 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:30.741445 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83e3e39b-5132-4089-aca6-3020d2da4767 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:30.741930 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83e3e39b-5132-4089-aca6-3020d2da4767 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:30.742372 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83e3e39b-5132-4089-aca6-3020d2da4767 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:30.743059 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83e3e39b-5132-4089-aca6-3020d2da4767 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:30.743512 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83e3e39b-5132-4089-aca6-3020d2da4767 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:30.743932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83e3e39b-5132-4089-aca6-3020d2da4767 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:30.874041 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-83e3e39b-5132-4089-aca6-3020d2da4767 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:30.883654 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-83e3e39b-5132-4089-aca6-3020d2da4767 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.154146 Sep 26 05:32:30.897249 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 221/460] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:30 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:31.023624 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-aeac40fc-98c9-4583-b52d-d1f31ebc18e7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:31.024234 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-aeac40fc-98c9-4583-b52d-d1f31ebc18e7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:31.030229 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-aeac40fc-98c9-4583-b52d-d1f31ebc18e7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:31.030703 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-aeac40fc-98c9-4583-b52d-d1f31ebc18e7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:31.031133 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-aeac40fc-98c9-4583-b52d-d1f31ebc18e7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:31.031805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-aeac40fc-98c9-4583-b52d-d1f31ebc18e7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:31.032268 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-aeac40fc-98c9-4583-b52d-d1f31ebc18e7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:31.032701 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-aeac40fc-98c9-4583-b52d-d1f31ebc18e7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:31.174332 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-aeac40fc-98c9-4583-b52d-d1f31ebc18e7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:31.183163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-aeac40fc-98c9-4583-b52d-d1f31ebc18e7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:31.184632 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-aeac40fc-98c9-4583-b52d-d1f31ebc18e7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:31.185781 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-aeac40fc-98c9-4583-b52d-d1f31ebc18e7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.166604 Sep 26 05:32:31.186337 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 240/461] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:31 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:31.906849 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-91ea9068-46e9-4c2c-aa85-e1b6c630bb55 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:31.907460 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-91ea9068-46e9-4c2c-aa85-e1b6c630bb55 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:31.914044 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-91ea9068-46e9-4c2c-aa85-e1b6c630bb55 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:31.914521 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-91ea9068-46e9-4c2c-aa85-e1b6c630bb55 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:31.914952 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-91ea9068-46e9-4c2c-aa85-e1b6c630bb55 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:31.915628 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-91ea9068-46e9-4c2c-aa85-e1b6c630bb55 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:31.916075 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-91ea9068-46e9-4c2c-aa85-e1b6c630bb55 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:31.916521 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-91ea9068-46e9-4c2c-aa85-e1b6c630bb55 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:32.063277 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-91ea9068-46e9-4c2c-aa85-e1b6c630bb55 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:32.071220 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-91ea9068-46e9-4c2c-aa85-e1b6c630bb55 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.168139 Sep 26 05:32:32.071790 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 222/462] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:31 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:32.211089 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-0bfd41d1-25d5-4204-a363-58e81fc4d4c0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:32.211698 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-0bfd41d1-25d5-4204-a363-58e81fc4d4c0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:32.217770 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0bfd41d1-25d5-4204-a363-58e81fc4d4c0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:32.218246 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0bfd41d1-25d5-4204-a363-58e81fc4d4c0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:32.218674 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0bfd41d1-25d5-4204-a363-58e81fc4d4c0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:32.219351 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0bfd41d1-25d5-4204-a363-58e81fc4d4c0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:32.219798 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0bfd41d1-25d5-4204-a363-58e81fc4d4c0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:32.220216 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0bfd41d1-25d5-4204-a363-58e81fc4d4c0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:32.357435 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0bfd41d1-25d5-4204-a363-58e81fc4d4c0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:32.366881 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0bfd41d1-25d5-4204-a363-58e81fc4d4c0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:32.368381 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0bfd41d1-25d5-4204-a363-58e81fc4d4c0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:32.369544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-0bfd41d1-25d5-4204-a363-58e81fc4d4c0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.162387 Sep 26 05:32:32.370102 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 241/463] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:32 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:33.094718 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d331fbe8-ac78-4c5e-9a3b-1839b244e0a4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:33.095225 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d331fbe8-ac78-4c5e-9a3b-1839b244e0a4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:33.101740 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d331fbe8-ac78-4c5e-9a3b-1839b244e0a4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:33.102222 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d331fbe8-ac78-4c5e-9a3b-1839b244e0a4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:33.102651 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d331fbe8-ac78-4c5e-9a3b-1839b244e0a4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:33.103333 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d331fbe8-ac78-4c5e-9a3b-1839b244e0a4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:33.103778 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d331fbe8-ac78-4c5e-9a3b-1839b244e0a4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:33.104220 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d331fbe8-ac78-4c5e-9a3b-1839b244e0a4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:33.231547 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d331fbe8-ac78-4c5e-9a3b-1839b244e0a4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:33.239660 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d331fbe8-ac78-4c5e-9a3b-1839b244e0a4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.148945 Sep 26 05:32:33.240217 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 223/464] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:33 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:33.394365 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-017b1e34-1a7b-43e3-bc55-6df69d9636a3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:33.395640 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-017b1e34-1a7b-43e3-bc55-6df69d9636a3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:33.401624 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-017b1e34-1a7b-43e3-bc55-6df69d9636a3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:33.402109 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-017b1e34-1a7b-43e3-bc55-6df69d9636a3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:33.402540 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-017b1e34-1a7b-43e3-bc55-6df69d9636a3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:33.403224 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-017b1e34-1a7b-43e3-bc55-6df69d9636a3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:33.403670 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-017b1e34-1a7b-43e3-bc55-6df69d9636a3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:33.404085 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-017b1e34-1a7b-43e3-bc55-6df69d9636a3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:33.532322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-017b1e34-1a7b-43e3-bc55-6df69d9636a3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:33.543925 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-017b1e34-1a7b-43e3-bc55-6df69d9636a3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:33.545375 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-017b1e34-1a7b-43e3-bc55-6df69d9636a3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:33.546544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-017b1e34-1a7b-43e3-bc55-6df69d9636a3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.156141 Sep 26 05:32:33.547100 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 242/465] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:33 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:34.262946 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e8f6e492-6c27-452f-b3dd-c6efd60177c9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:34.263553 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e8f6e492-6c27-452f-b3dd-c6efd60177c9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:34.270012 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e8f6e492-6c27-452f-b3dd-c6efd60177c9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:34.270500 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e8f6e492-6c27-452f-b3dd-c6efd60177c9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:34.270936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e8f6e492-6c27-452f-b3dd-c6efd60177c9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:34.271625 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e8f6e492-6c27-452f-b3dd-c6efd60177c9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:34.272075 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e8f6e492-6c27-452f-b3dd-c6efd60177c9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:34.272525 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e8f6e492-6c27-452f-b3dd-c6efd60177c9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:34.403228 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e8f6e492-6c27-452f-b3dd-c6efd60177c9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:34.411432 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e8f6e492-6c27-452f-b3dd-c6efd60177c9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.152344 Sep 26 05:32:34.411990 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 224/466] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:34 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:34.572113 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-493bfbdb-9177-4b96-8ba5-1aa557217471 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:34.572749 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-493bfbdb-9177-4b96-8ba5-1aa557217471 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:34.578518 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-493bfbdb-9177-4b96-8ba5-1aa557217471 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:34.578992 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-493bfbdb-9177-4b96-8ba5-1aa557217471 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:34.579423 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-493bfbdb-9177-4b96-8ba5-1aa557217471 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:34.580104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-493bfbdb-9177-4b96-8ba5-1aa557217471 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:34.580605 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-493bfbdb-9177-4b96-8ba5-1aa557217471 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:34.581028 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-493bfbdb-9177-4b96-8ba5-1aa557217471 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:34.708696 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-493bfbdb-9177-4b96-8ba5-1aa557217471 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:34.717278 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-493bfbdb-9177-4b96-8ba5-1aa557217471 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:34.718730 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-493bfbdb-9177-4b96-8ba5-1aa557217471 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:34.719881 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-493bfbdb-9177-4b96-8ba5-1aa557217471 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.151652 Sep 26 05:32:34.720465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 243/467] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:34 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:35.435132 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-45241bf6-2e83-4ed7-8e6d-f7c211e99c72 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:35.435753 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-45241bf6-2e83-4ed7-8e6d-f7c211e99c72 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:35.438074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=58 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:35.443673 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-45241bf6-2e83-4ed7-8e6d-f7c211e99c72 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:35.444169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-45241bf6-2e83-4ed7-8e6d-f7c211e99c72 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:35.444635 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-45241bf6-2e83-4ed7-8e6d-f7c211e99c72 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:35.445335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-45241bf6-2e83-4ed7-8e6d-f7c211e99c72 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:35.445793 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-45241bf6-2e83-4ed7-8e6d-f7c211e99c72 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:35.446219 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-45241bf6-2e83-4ed7-8e6d-f7c211e99c72 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:35.650821 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-45241bf6-2e83-4ed7-8e6d-f7c211e99c72 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:35.658829 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-45241bf6-2e83-4ed7-8e6d-f7c211e99c72 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1511 microversion: 2.1 time: 0.227612 Sep 26 05:32:35.659382 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 225/468] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:35 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1511 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:35.745468 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1f4b98e0-26c5-4292-8170-4a33218f7eed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:35.746751 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-1f4b98e0-26c5-4292-8170-4a33218f7eed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:35.752478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f4b98e0-26c5-4292-8170-4a33218f7eed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:35.752962 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f4b98e0-26c5-4292-8170-4a33218f7eed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:35.753393 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f4b98e0-26c5-4292-8170-4a33218f7eed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:35.754688 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f4b98e0-26c5-4292-8170-4a33218f7eed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:35.755199 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f4b98e0-26c5-4292-8170-4a33218f7eed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:35.755620 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f4b98e0-26c5-4292-8170-4a33218f7eed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:35.866518 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-edce437f-33fd-4563-a9b4-a6f1df66d6a3 req-fe8aa36b-b3ae-4fca-962f-a97c49760e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7efac409-bfde-4b69-a933-f76bf0442c1b", "name": "network-vif-deleted", "tag": "48afb2fc-5507-40ee-ac44-fdd6ed4af3d2"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:32:35.876567 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-edce437f-33fd-4563-a9b4-a6f1df66d6a3 req-fe8aa36b-b3ae-4fca-962f-a97c49760e4b service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:35.877238 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-edce437f-33fd-4563-a9b4-a6f1df66d6a3 req-fe8aa36b-b3ae-4fca-962f-a97c49760e4b service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:35.877561 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-edce437f-33fd-4563-a9b4-a6f1df66d6a3 req-fe8aa36b-b3ae-4fca-962f-a97c49760e4b service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:35.889735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-edce437f-33fd-4563-a9b4-a6f1df66d6a3 req-fe8aa36b-b3ae-4fca-962f-a97c49760e4b service nova] Creating event network-vif-deleted:48afb2fc-5507-40ee-ac44-fdd6ed4af3d2 for instance 7efac409-bfde-4b69-a933-f76bf0442c1b on hv-cinder-85918 Sep 26 05:32:35.894784 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-edce437f-33fd-4563-a9b4-a6f1df66d6a3 req-fe8aa36b-b3ae-4fca-962f-a97c49760e4b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032615 Sep 26 05:32:35.895533 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 226/469] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:32:35.932754 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1f4b98e0-26c5-4292-8170-4a33218f7eed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:35.941265 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1f4b98e0-26c5-4292-8170-4a33218f7eed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:35.942758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1f4b98e0-26c5-4292-8170-4a33218f7eed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:35.943898 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1f4b98e0-26c5-4292-8170-4a33218f7eed tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.202271 Sep 26 05:32:35.944471 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 244/470] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:35 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:36.682935 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-90b14ea8-99f1-48ad-93ed-62532add8749 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:36.683707 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-90b14ea8-99f1-48ad-93ed-62532add8749 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:36.690667 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90b14ea8-99f1-48ad-93ed-62532add8749 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:36.691149 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90b14ea8-99f1-48ad-93ed-62532add8749 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:36.692446 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90b14ea8-99f1-48ad-93ed-62532add8749 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:36.693141 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90b14ea8-99f1-48ad-93ed-62532add8749 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:36.693592 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90b14ea8-99f1-48ad-93ed-62532add8749 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:36.694037 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90b14ea8-99f1-48ad-93ed-62532add8749 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:36.725691 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90b14ea8-99f1-48ad-93ed-62532add8749 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:36.726166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90b14ea8-99f1-48ad-93ed-62532add8749 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:36.726595 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90b14ea8-99f1-48ad-93ed-62532add8749 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:36.727030 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-90b14ea8-99f1-48ad-93ed-62532add8749 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lazy-loading 'fault' on Instance uuid 7efac409-bfde-4b69-a933-f76bf0442c1b {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:32:36.771438 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-90b14ea8-99f1-48ad-93ed-62532add8749 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:36.779044 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-90b14ea8-99f1-48ad-93ed-62532add8749 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1306 microversion: 2.1 time: 0.100195 Sep 26 05:32:36.779588 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 227/471] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:36 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1306 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:36.969217 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-714daf03-fb78-4668-a2c8-b5db190abec6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:36.969826 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-714daf03-fb78-4668-a2c8-b5db190abec6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:36.975790 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-714daf03-fb78-4668-a2c8-b5db190abec6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:36.976302 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-714daf03-fb78-4668-a2c8-b5db190abec6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:36.976739 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-714daf03-fb78-4668-a2c8-b5db190abec6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:36.977422 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-714daf03-fb78-4668-a2c8-b5db190abec6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:36.977871 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-714daf03-fb78-4668-a2c8-b5db190abec6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:36.978293 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-714daf03-fb78-4668-a2c8-b5db190abec6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:37.104330 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-714daf03-fb78-4668-a2c8-b5db190abec6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:37.113816 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-714daf03-fb78-4668-a2c8-b5db190abec6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:37.115244 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-714daf03-fb78-4668-a2c8-b5db190abec6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:37.116415 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-714daf03-fb78-4668-a2c8-b5db190abec6 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.151101 Sep 26 05:32:37.116970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 245/472] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:36 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:37.802832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-72172d74-62ce-420d-9a54-da6f040577a3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:37.803447 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-72172d74-62ce-420d-9a54-da6f040577a3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:37.809857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-72172d74-62ce-420d-9a54-da6f040577a3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:37.810337 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-72172d74-62ce-420d-9a54-da6f040577a3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:37.810775 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-72172d74-62ce-420d-9a54-da6f040577a3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:37.811463 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-72172d74-62ce-420d-9a54-da6f040577a3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:37.811918 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-72172d74-62ce-420d-9a54-da6f040577a3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:37.812372 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-72172d74-62ce-420d-9a54-da6f040577a3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:37.843536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-72172d74-62ce-420d-9a54-da6f040577a3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:37.844019 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-72172d74-62ce-420d-9a54-da6f040577a3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:37.844497 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-72172d74-62ce-420d-9a54-da6f040577a3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:37.844946 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-72172d74-62ce-420d-9a54-da6f040577a3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lazy-loading 'fault' on Instance uuid 7efac409-bfde-4b69-a933-f76bf0442c1b {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:32:37.884887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-72172d74-62ce-420d-9a54-da6f040577a3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:37.892758 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-72172d74-62ce-420d-9a54-da6f040577a3 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 200 len: 1306 microversion: 2.1 time: 0.093865 Sep 26 05:32:37.893339 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 228/473] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:37 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 1306 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:38.141306 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e48fe20b-6f38-4992-8dc4-23e6d81b25cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:38.141924 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e48fe20b-6f38-4992-8dc4-23e6d81b25cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:38.143802 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:38.149428 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e48fe20b-6f38-4992-8dc4-23e6d81b25cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:38.149920 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e48fe20b-6f38-4992-8dc4-23e6d81b25cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:38.150682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e48fe20b-6f38-4992-8dc4-23e6d81b25cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:38.151043 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e48fe20b-6f38-4992-8dc4-23e6d81b25cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:38.151494 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e48fe20b-6f38-4992-8dc4-23e6d81b25cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:38.151916 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e48fe20b-6f38-4992-8dc4-23e6d81b25cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:38.292992 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e48fe20b-6f38-4992-8dc4-23e6d81b25cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:38.303901 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e48fe20b-6f38-4992-8dc4-23e6d81b25cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:38.305732 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e48fe20b-6f38-4992-8dc4-23e6d81b25cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:38.307247 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e48fe20b-6f38-4992-8dc4-23e6d81b25cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.169788 Sep 26 05:32:38.308137 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 246/474] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:38 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:32:38.916139 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e718c58c-af80-4c1a-9806-05aa7412c199 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:38.916777 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e718c58c-af80-4c1a-9806-05aa7412c199 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 7efac409-bfde-4b69-a933-f76bf0442c1b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:38.923278 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e718c58c-af80-4c1a-9806-05aa7412c199 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:38.923748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e718c58c-af80-4c1a-9806-05aa7412c199 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:38.924177 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e718c58c-af80-4c1a-9806-05aa7412c199 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:38.924874 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e718c58c-af80-4c1a-9806-05aa7412c199 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:38.925318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e718c58c-af80-4c1a-9806-05aa7412c199 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:38.925733 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e718c58c-af80-4c1a-9806-05aa7412c199 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:38.940723 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-e718c58c-af80-4c1a-9806-05aa7412c199 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] HTTP exception thrown: Instance 7efac409-bfde-4b69-a933-f76bf0442c1b could not be found. Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e718c58c-af80-4c1a-9806-05aa7412c199 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Request method failure captured: Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b HTTP/1.1 Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTkIWz4r7VyOkqI7evq1PQUupA0KYhTobIR5Ht4Dmu6jASBBHWBhBYykfwxR2Ujc4uFsHR8n9hm66a9Sa2-PGj-ckmb61JR1DQeP5IkDOuBXFpwctTbYefNTjfBdKepsnk8VZQ3F8a1wMorz_FDHnq8mu9uwPNPM46pcBAjNVaaWku0 Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: 241e5470186a4c93b2465ecc84d80603 Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-VolumesSnapshotTestJSON-688590265 Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:32:38.942929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:32:38.944573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/241e5470186a4c93b2465ecc84d80603"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/241e5470186a4c93b2465ecc84d80603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/241e5470186a4c93b2465ecc84d80603"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_241e5470186a4c93b2465ecc84d80603"}]}] Sep 26 05:32:38.944573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-VolumesSnapshotTestJSON-688590265 Sep 26 05:32:38.944573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 241e5470186a4c93b2465ecc84d80603 Sep 26 05:32:38.944573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-688590265 Sep 26 05:32:38.944573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-VolumesSnapshotTestJSON-688590265-project Sep 26 05:32:38.944573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:32:38.944573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:32:38.944573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 1e391d2591734de3bbe2515c703c4602 Sep 26 05:32:38.944573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-VolumesSnapshotTestJSON-688590265-project Sep 26 05:32:38.944573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:32:38.944573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance 7efac409-bfde-4b69-a933-f76bf0442c1b could not be found. Sep 26 05:32:38.944573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': '7efac409-bfde-4b69-a933-f76bf0442c1b'} Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7efac409-bfde-4b69-a933-f76bf0442c1b could not be found. Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:32:38.945481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:32:38.946960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:32:38.946960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:32:38.946960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:32:38.946960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:32:38.946960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:32:38.946960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:32:38.946960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:32:38.946960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7efac409-bfde-4b69-a933-f76bf0442c1b could not be found. Sep 26 05:32:38.946960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:32:38.946960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:32:38.946960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:32:38.946960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:32:38.946960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:32:38.946960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:32:38.946960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:32:38.946960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:32:38.946960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7efac409-bfde-4b69-a933-f76bf0442c1b could not be found. Sep 26 05:32:38.946960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:32:38.948293 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e718c58c-af80-4c1a-9806-05aa7412c199 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Returning 404 to user: Instance 7efac409-bfde-4b69-a933-f76bf0442c1b could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:32:38.948293 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e718c58c-af80-4c1a-9806-05aa7412c199 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b" status: 404 len: 111 microversion: 2.1 time: 0.032033 Sep 26 05:32:38.948293 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 229/475] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:38 2022] GET /compute/v2.1/servers/7efac409-bfde-4b69-a933-f76bf0442c1b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:32:39.333429 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-211e687a-528e-4ce8-95b8-ba862d99dbcb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:39.334037 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-211e687a-528e-4ce8-95b8-ba862d99dbcb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:39.340140 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-211e687a-528e-4ce8-95b8-ba862d99dbcb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:39.340672 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-211e687a-528e-4ce8-95b8-ba862d99dbcb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:39.341105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-211e687a-528e-4ce8-95b8-ba862d99dbcb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:39.341794 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-211e687a-528e-4ce8-95b8-ba862d99dbcb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:39.342244 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-211e687a-528e-4ce8-95b8-ba862d99dbcb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:39.342668 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-211e687a-528e-4ce8-95b8-ba862d99dbcb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:39.473621 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-211e687a-528e-4ce8-95b8-ba862d99dbcb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:39.482372 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-211e687a-528e-4ce8-95b8-ba862d99dbcb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:39.483819 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-211e687a-528e-4ce8-95b8-ba862d99dbcb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:39.484996 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-211e687a-528e-4ce8-95b8-ba862d99dbcb tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.155528 Sep 26 05:32:39.485552 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 247/476] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:39 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:40.510727 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b3674149-ebd8-4df2-9156-2e837089a3bc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:40.511341 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b3674149-ebd8-4df2-9156-2e837089a3bc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:40.518192 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b3674149-ebd8-4df2-9156-2e837089a3bc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:40.518678 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b3674149-ebd8-4df2-9156-2e837089a3bc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:40.519116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b3674149-ebd8-4df2-9156-2e837089a3bc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:40.520529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b3674149-ebd8-4df2-9156-2e837089a3bc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:40.520989 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b3674149-ebd8-4df2-9156-2e837089a3bc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:40.521413 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b3674149-ebd8-4df2-9156-2e837089a3bc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:40.653975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b3674149-ebd8-4df2-9156-2e837089a3bc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:40.662666 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b3674149-ebd8-4df2-9156-2e837089a3bc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:40.664093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b3674149-ebd8-4df2-9156-2e837089a3bc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:40.665271 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b3674149-ebd8-4df2-9156-2e837089a3bc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.158501 Sep 26 05:32:40.665821 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 230/477] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:40 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:41.430738 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-525969d1-48dd-4d03-9581-fcf394d086df tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:41.431276 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-525969d1-48dd-4d03-9581-fcf394d086df tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:41.437120 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-525969d1-48dd-4d03-9581-fcf394d086df tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:41.437598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-525969d1-48dd-4d03-9581-fcf394d086df tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:41.438031 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-525969d1-48dd-4d03-9581-fcf394d086df tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:41.438704 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-525969d1-48dd-4d03-9581-fcf394d086df tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:41.439149 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-525969d1-48dd-4d03-9581-fcf394d086df tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:41.439565 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-525969d1-48dd-4d03-9581-fcf394d086df tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:41.462695 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-525969d1-48dd-4d03-9581-fcf394d086df tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47/ips" status: 200 len: 145 microversion: 2.1 time: 0.036060 Sep 26 05:32:41.463237 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 248/478] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 05:32:41 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:32:41.690782 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2c81436d-d313-469c-8b7d-67980f2ba21f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:41.691451 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2c81436d-d313-469c-8b7d-67980f2ba21f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:41.698055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c81436d-d313-469c-8b7d-67980f2ba21f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:41.698560 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c81436d-d313-469c-8b7d-67980f2ba21f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:41.698992 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c81436d-d313-469c-8b7d-67980f2ba21f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:41.699690 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c81436d-d313-469c-8b7d-67980f2ba21f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:41.700135 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c81436d-d313-469c-8b7d-67980f2ba21f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:41.700637 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c81436d-d313-469c-8b7d-67980f2ba21f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:41.826254 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2c81436d-d313-469c-8b7d-67980f2ba21f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:41.835793 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2c81436d-d313-469c-8b7d-67980f2ba21f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:41.837286 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2c81436d-d313-469c-8b7d-67980f2ba21f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:41.838426 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2c81436d-d313-469c-8b7d-67980f2ba21f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.151623 Sep 26 05:32:41.838974 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 231/479] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:41 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:42.863811 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a542a076-20dc-4c79-bd84-02a252a3ea76 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:42.864504 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a542a076-20dc-4c79-bd84-02a252a3ea76 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:42.870463 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a542a076-20dc-4c79-bd84-02a252a3ea76 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:42.870941 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a542a076-20dc-4c79-bd84-02a252a3ea76 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:42.871367 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a542a076-20dc-4c79-bd84-02a252a3ea76 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:42.872051 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a542a076-20dc-4c79-bd84-02a252a3ea76 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:42.872546 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a542a076-20dc-4c79-bd84-02a252a3ea76 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:42.872980 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a542a076-20dc-4c79-bd84-02a252a3ea76 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:43.005560 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a542a076-20dc-4c79-bd84-02a252a3ea76 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:43.014318 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a542a076-20dc-4c79-bd84-02a252a3ea76 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:43.015777 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a542a076-20dc-4c79-bd84-02a252a3ea76 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:43.016993 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a542a076-20dc-4c79-bd84-02a252a3ea76 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.157972 Sep 26 05:32:43.017552 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 249/480] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:42 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:44.043625 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-171b5d17-40e8-42ae-a222-488737497991 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:44.044280 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-171b5d17-40e8-42ae-a222-488737497991 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:44.050743 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-171b5d17-40e8-42ae-a222-488737497991 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:44.051218 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-171b5d17-40e8-42ae-a222-488737497991 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:44.051653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-171b5d17-40e8-42ae-a222-488737497991 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:44.052368 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-171b5d17-40e8-42ae-a222-488737497991 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:44.052821 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-171b5d17-40e8-42ae-a222-488737497991 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:44.053247 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-171b5d17-40e8-42ae-a222-488737497991 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:44.057212 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:44.179117 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-171b5d17-40e8-42ae-a222-488737497991 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:44.187697 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-171b5d17-40e8-42ae-a222-488737497991 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:44.189181 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-171b5d17-40e8-42ae-a222-488737497991 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:44.190337 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-171b5d17-40e8-42ae-a222-488737497991 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.150636 Sep 26 05:32:44.191396 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 232/481] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:44 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:45.216273 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d0146407-92ac-4864-a219-6cac1297b680 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:45.216885 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d0146407-92ac-4864-a219-6cac1297b680 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:45.223870 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d0146407-92ac-4864-a219-6cac1297b680 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:45.224393 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d0146407-92ac-4864-a219-6cac1297b680 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:45.224840 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d0146407-92ac-4864-a219-6cac1297b680 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:45.225529 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d0146407-92ac-4864-a219-6cac1297b680 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:45.225986 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d0146407-92ac-4864-a219-6cac1297b680 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:45.226413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d0146407-92ac-4864-a219-6cac1297b680 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:45.356213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d0146407-92ac-4864-a219-6cac1297b680 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:45.365679 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d0146407-92ac-4864-a219-6cac1297b680 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:45.367055 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d0146407-92ac-4864-a219-6cac1297b680 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:45.368202 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d0146407-92ac-4864-a219-6cac1297b680 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.155897 Sep 26 05:32:45.368789 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 250/482] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:45 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:46.393788 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f035984e-e6ad-4eb6-aa26-5a551bd2435d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:46.395006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f035984e-e6ad-4eb6-aa26-5a551bd2435d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:46.401552 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f035984e-e6ad-4eb6-aa26-5a551bd2435d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:46.402033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f035984e-e6ad-4eb6-aa26-5a551bd2435d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:46.402468 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f035984e-e6ad-4eb6-aa26-5a551bd2435d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:46.403152 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f035984e-e6ad-4eb6-aa26-5a551bd2435d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:46.403601 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f035984e-e6ad-4eb6-aa26-5a551bd2435d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:46.404028 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f035984e-e6ad-4eb6-aa26-5a551bd2435d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:46.534546 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f035984e-e6ad-4eb6-aa26-5a551bd2435d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:46.543066 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f035984e-e6ad-4eb6-aa26-5a551bd2435d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:46.544543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f035984e-e6ad-4eb6-aa26-5a551bd2435d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:46.545680 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f035984e-e6ad-4eb6-aa26-5a551bd2435d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.155920 Sep 26 05:32:46.546234 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 233/483] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:46 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:47.571114 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6ec04504-b96c-4f1a-811c-554bdf8702fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:47.571721 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6ec04504-b96c-4f1a-811c-554bdf8702fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:47.578047 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6ec04504-b96c-4f1a-811c-554bdf8702fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:47.578524 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6ec04504-b96c-4f1a-811c-554bdf8702fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:47.578954 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6ec04504-b96c-4f1a-811c-554bdf8702fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:47.579627 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6ec04504-b96c-4f1a-811c-554bdf8702fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:47.580070 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6ec04504-b96c-4f1a-811c-554bdf8702fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:47.580647 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6ec04504-b96c-4f1a-811c-554bdf8702fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:47.707997 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6ec04504-b96c-4f1a-811c-554bdf8702fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:47.717386 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6ec04504-b96c-4f1a-811c-554bdf8702fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:47.718536 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6ec04504-b96c-4f1a-811c-554bdf8702fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:47.719697 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6ec04504-b96c-4f1a-811c-554bdf8702fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.152481 Sep 26 05:32:47.720235 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 251/484] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:47 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:48.750268 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-438eaa3b-9c6b-4c00-b34c-1c90e7f4195a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:48.750268 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-438eaa3b-9c6b-4c00-b34c-1c90e7f4195a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:48.752385 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-438eaa3b-9c6b-4c00-b34c-1c90e7f4195a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:48.752505 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-438eaa3b-9c6b-4c00-b34c-1c90e7f4195a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:48.756478 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-438eaa3b-9c6b-4c00-b34c-1c90e7f4195a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:48.756478 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-438eaa3b-9c6b-4c00-b34c-1c90e7f4195a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:48.756478 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-438eaa3b-9c6b-4c00-b34c-1c90e7f4195a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:48.756478 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-438eaa3b-9c6b-4c00-b34c-1c90e7f4195a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:48.866371 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f2a11bea-39c4-48e6-b176-50682b91ace7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1892872351", "imageRef": "d37a4f3d-6311-48af-9e33-4c62c14cdd1a", "flavorRef": "452", "networks": [{"uuid": "64bcaa83-8e16-496d-9ee2-d2efca0f0f90"}]}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:32:48.897677 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-438eaa3b-9c6b-4c00-b34c-1c90e7f4195a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:48.907341 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-438eaa3b-9c6b-4c00-b34c-1c90e7f4195a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:48.910349 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-438eaa3b-9c6b-4c00-b34c-1c90e7f4195a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:48.911900 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-438eaa3b-9c6b-4c00-b34c-1c90e7f4195a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.170971 Sep 26 05:32:48.913342 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 234/485] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:48 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:48.931346 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.network.neutron [None req-f2a11bea-39c4-48e6-b176-50682b91ace7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] validate_networks() for [('64bcaa83-8e16-496d-9ee2-d2efca0f0f90', None, None, None, None, None)] {{(pid=120806) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:32:49.303632 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-f2a11bea-39c4-48e6-b176-50682b91ace7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Flavor limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:32:49.304052 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-f2a11bea-39c4-48e6-b176-50682b91ace7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Image limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:32:49.304550 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-f2a11bea-39c4-48e6-b176-50682b91ace7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Flavor pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:32:49.304957 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-f2a11bea-39c4-48e6-b176-50682b91ace7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Image pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:32:49.305365 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-f2a11bea-39c4-48e6-b176-50682b91ace7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:32:49.314861 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f2a11bea-39c4-48e6-b176-50682b91ace7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:49.315346 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f2a11bea-39c4-48e6-b176-50682b91ace7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:49.316503 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f2a11bea-39c4-48e6-b176-50682b91ace7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:49.317444 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f2a11bea-39c4-48e6-b176-50682b91ace7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:49.317901 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f2a11bea-39c4-48e6-b176-50682b91ace7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:49.318327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f2a11bea-39c4-48e6-b176-50682b91ace7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:49.335405 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-f2a11bea-39c4-48e6-b176-50682b91ace7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Getting quotas for project 241e5470186a4c93b2465ecc84d80603. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:32:49.339346 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-f2a11bea-39c4-48e6-b176-50682b91ace7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Getting quotas for user 1e391d2591734de3bbe2515c703c4602 and project 241e5470186a4c93b2465ecc84d80603. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:32:49.350413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f2a11bea-39c4-48e6-b176-50682b91ace7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Going to run 1 instances... {{(pid=120806) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:32:49.352731 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f2a11bea-39c4-48e6-b176-50682b91ace7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d37a4f3d-6311-48af-9e33-4c62c14cdd1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120806) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:32:49.399811 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f2a11bea-39c4-48e6-b176-50682b91ace7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538986 Sep 26 05:32:49.400486 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 252/486] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:32:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:32:49.412074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0c73febe-4c2e-4c8e-ace3-30fe6eae921b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:49.412784 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0c73febe-4c2e-4c8e-ace3-30fe6eae921b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:49.468208 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0c73febe-4c2e-4c8e-ace3-30fe6eae921b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:49.475003 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0c73febe-4c2e-4c8e-ace3-30fe6eae921b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1219 microversion: 2.1 time: 0.066787 Sep 26 05:32:49.475569 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 235/487] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:49 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:49.942558 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a15300e7-ea97-4b5a-9796-64ccb3815e00 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:49.943213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a15300e7-ea97-4b5a-9796-64ccb3815e00 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:49.949264 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a15300e7-ea97-4b5a-9796-64ccb3815e00 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:49.949755 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a15300e7-ea97-4b5a-9796-64ccb3815e00 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:49.950221 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a15300e7-ea97-4b5a-9796-64ccb3815e00 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:49.950903 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a15300e7-ea97-4b5a-9796-64ccb3815e00 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:49.951360 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a15300e7-ea97-4b5a-9796-64ccb3815e00 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:49.951789 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a15300e7-ea97-4b5a-9796-64ccb3815e00 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:50.082929 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a15300e7-ea97-4b5a-9796-64ccb3815e00 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:50.092005 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a15300e7-ea97-4b5a-9796-64ccb3815e00 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:50.093472 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a15300e7-ea97-4b5a-9796-64ccb3815e00 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:50.094616 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a15300e7-ea97-4b5a-9796-64ccb3815e00 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.156754 Sep 26 05:32:50.095215 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 253/488] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:49 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:50.236531 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fc354265-cff7-44dc-8162-374f33f23f24 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a0a6af8-8f14-4b17-af23-cfe0b604e9c4"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:32:50.239847 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fc354265-cff7-44dc-8162-374f33f23f24 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:50.246887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fc354265-cff7-44dc-8162-374f33f23f24 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:50.247364 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fc354265-cff7-44dc-8162-374f33f23f24 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:50.247793 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fc354265-cff7-44dc-8162-374f33f23f24 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:50.248507 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fc354265-cff7-44dc-8162-374f33f23f24 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:50.248950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fc354265-cff7-44dc-8162-374f33f23f24 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:50.249367 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fc354265-cff7-44dc-8162-374f33f23f24 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:50.500758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a554806b-71a4-4f96-a1e4-15b7c750d8f4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:50.501588 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a554806b-71a4-4f96-a1e4-15b7c750d8f4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:50.509701 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a554806b-71a4-4f96-a1e4-15b7c750d8f4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:50.510400 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a554806b-71a4-4f96-a1e4-15b7c750d8f4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:50.511158 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a554806b-71a4-4f96-a1e4-15b7c750d8f4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:50.511992 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a554806b-71a4-4f96-a1e4-15b7c750d8f4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:50.512618 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a554806b-71a4-4f96-a1e4-15b7c750d8f4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:50.513175 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a554806b-71a4-4f96-a1e4-15b7c750d8f4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:50.556347 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fc354265-cff7-44dc-8162-374f33f23f24 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "POST /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323533 Sep 26 05:32:50.562750 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 236/489] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 05:32:50 2022] POST /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:32:50.588345 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a554806b-71a4-4f96-a1e4-15b7c750d8f4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:50.598948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a554806b-71a4-4f96-a1e4-15b7c750d8f4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1271 microversion: 2.1 time: 0.104405 Sep 26 05:32:50.599637 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 254/490] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:50 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1271 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:32:51.122509 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-41053eb8-cc93-4bdc-9b19-5471e7da112c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:51.123208 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-41053eb8-cc93-4bdc-9b19-5471e7da112c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:51.135285 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-41053eb8-cc93-4bdc-9b19-5471e7da112c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:51.135784 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-41053eb8-cc93-4bdc-9b19-5471e7da112c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:51.136269 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-41053eb8-cc93-4bdc-9b19-5471e7da112c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:51.136937 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-41053eb8-cc93-4bdc-9b19-5471e7da112c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:51.137388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-41053eb8-cc93-4bdc-9b19-5471e7da112c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:51.137814 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-41053eb8-cc93-4bdc-9b19-5471e7da112c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:51.156694 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-073926df-97f2-4a34-9fa7-77d3dcd70ee2 req-09770a84-2776-467f-8719-c15e035d0b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffa337e-39e1-4edc-9a0d-4468ff05c577", "name": "network-vif-plugged", "status": "completed", "tag": "db14dfec-952b-46e2-9617-72801c005bb3"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:32:51.177973 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-073926df-97f2-4a34-9fa7-77d3dcd70ee2 req-09770a84-2776-467f-8719-c15e035d0b7f service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:51.178469 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-073926df-97f2-4a34-9fa7-77d3dcd70ee2 req-09770a84-2776-467f-8719-c15e035d0b7f service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:51.179111 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-073926df-97f2-4a34-9fa7-77d3dcd70ee2 req-09770a84-2776-467f-8719-c15e035d0b7f service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:51.198578 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-073926df-97f2-4a34-9fa7-77d3dcd70ee2 req-09770a84-2776-467f-8719-c15e035d0b7f service nova] Creating event network-vif-plugged:db14dfec-952b-46e2-9617-72801c005bb3 for instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 on hv-cinder-85918 Sep 26 05:32:51.203799 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-073926df-97f2-4a34-9fa7-77d3dcd70ee2 req-09770a84-2776-467f-8719-c15e035d0b7f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051290 Sep 26 05:32:51.204526 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 255/491] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:32:51.302952 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-41053eb8-cc93-4bdc-9b19-5471e7da112c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:51.318691 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-41053eb8-cc93-4bdc-9b19-5471e7da112c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:51.320155 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-41053eb8-cc93-4bdc-9b19-5471e7da112c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:51.321366 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-41053eb8-cc93-4bdc-9b19-5471e7da112c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.203561 Sep 26 05:32:51.321939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 237/492] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:51 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:51.625241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-efe23c7a-b127-4a3e-ba48-76772513e74b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:51.625987 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-efe23c7a-b127-4a3e-ba48-76772513e74b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:51.633070 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-efe23c7a-b127-4a3e-ba48-76772513e74b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:51.633640 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-efe23c7a-b127-4a3e-ba48-76772513e74b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:51.634073 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-efe23c7a-b127-4a3e-ba48-76772513e74b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:51.634769 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-efe23c7a-b127-4a3e-ba48-76772513e74b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:51.635362 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-efe23c7a-b127-4a3e-ba48-76772513e74b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:51.635770 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-efe23c7a-b127-4a3e-ba48-76772513e74b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:51.775442 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-efe23c7a-b127-4a3e-ba48-76772513e74b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:51.779263 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=100 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:51.784882 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-efe23c7a-b127-4a3e-ba48-76772513e74b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1319 microversion: 2.1 time: 0.163325 Sep 26 05:32:51.785455 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 256/493] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:51 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:52.346531 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-472bd35c-d5c9-4d8e-8228-09b62c74145d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:52.347169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-472bd35c-d5c9-4d8e-8228-09b62c74145d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:52.353535 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-472bd35c-d5c9-4d8e-8228-09b62c74145d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:52.354011 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-472bd35c-d5c9-4d8e-8228-09b62c74145d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:52.354441 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-472bd35c-d5c9-4d8e-8228-09b62c74145d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:52.355148 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-472bd35c-d5c9-4d8e-8228-09b62c74145d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:52.355851 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-472bd35c-d5c9-4d8e-8228-09b62c74145d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:52.356302 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-472bd35c-d5c9-4d8e-8228-09b62c74145d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:52.479048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-78485f53-5014-4d9b-97da-35a40dcb259d req-f38ff82a-9924-4b4e-aff3-5f8d466c5bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47570062-ca33-436f-ab80-34918ac9c78e", "tag": "f45daf39-254f-46e8-9700-adeb9299ab9b"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:32:52.488634 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-472bd35c-d5c9-4d8e-8228-09b62c74145d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:52.490069 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-78485f53-5014-4d9b-97da-35a40dcb259d req-f38ff82a-9924-4b4e-aff3-5f8d466c5bc7 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:52.490658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-78485f53-5014-4d9b-97da-35a40dcb259d req-f38ff82a-9924-4b4e-aff3-5f8d466c5bc7 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:52.491194 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-78485f53-5014-4d9b-97da-35a40dcb259d req-f38ff82a-9924-4b4e-aff3-5f8d466c5bc7 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:52.500165 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-472bd35c-d5c9-4d8e-8228-09b62c74145d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:52.501633 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-472bd35c-d5c9-4d8e-8228-09b62c74145d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:52.502789 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-472bd35c-d5c9-4d8e-8228-09b62c74145d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.160143 Sep 26 05:32:52.503837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 238/494] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:52 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:52.514451 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-78485f53-5014-4d9b-97da-35a40dcb259d req-f38ff82a-9924-4b4e-aff3-5f8d466c5bc7 service nova] Creating event network-changed:f45daf39-254f-46e8-9700-adeb9299ab9b for instance 47570062-ca33-436f-ab80-34918ac9c78e on hv-cinder-85918 Sep 26 05:32:52.514451 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-78485f53-5014-4d9b-97da-35a40dcb259d req-f38ff82a-9924-4b4e-aff3-5f8d466c5bc7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034359 Sep 26 05:32:52.514451 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 257/495] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:32:52.809324 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c0af16a0-ac2e-4f47-9b6d-6e836b1dd24d tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:52.810020 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c0af16a0-ac2e-4f47-9b6d-6e836b1dd24d tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:52.816880 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c0af16a0-ac2e-4f47-9b6d-6e836b1dd24d tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:52.817364 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c0af16a0-ac2e-4f47-9b6d-6e836b1dd24d tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:52.817798 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c0af16a0-ac2e-4f47-9b6d-6e836b1dd24d tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:52.818485 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c0af16a0-ac2e-4f47-9b6d-6e836b1dd24d tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:52.819562 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c0af16a0-ac2e-4f47-9b6d-6e836b1dd24d tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:52.820001 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c0af16a0-ac2e-4f47-9b6d-6e836b1dd24d tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:52.951680 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-c0af16a0-ac2e-4f47-9b6d-6e836b1dd24d tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:52.959801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c0af16a0-ac2e-4f47-9b6d-6e836b1dd24d tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1319 microversion: 2.1 time: 0.154652 Sep 26 05:32:52.960497 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 258/496] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:52 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:53.529809 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-334cf484-1ab7-490a-afd2-6a9581e3b9e4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:53.530542 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-334cf484-1ab7-490a-afd2-6a9581e3b9e4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:53.538041 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-334cf484-1ab7-490a-afd2-6a9581e3b9e4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:53.538530 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-334cf484-1ab7-490a-afd2-6a9581e3b9e4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:53.538964 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-334cf484-1ab7-490a-afd2-6a9581e3b9e4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:53.539699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-334cf484-1ab7-490a-afd2-6a9581e3b9e4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:53.540148 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-334cf484-1ab7-490a-afd2-6a9581e3b9e4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:53.540633 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-334cf484-1ab7-490a-afd2-6a9581e3b9e4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:53.682936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-334cf484-1ab7-490a-afd2-6a9581e3b9e4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:53.691752 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-334cf484-1ab7-490a-afd2-6a9581e3b9e4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:53.693227 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-334cf484-1ab7-490a-afd2-6a9581e3b9e4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:53.694371 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-334cf484-1ab7-490a-afd2-6a9581e3b9e4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.168796 Sep 26 05:32:53.694921 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 239/497] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:53 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:32:53.983101 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7966dcc1-24da-484b-bfbd-0badaa769636 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:53.983824 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7966dcc1-24da-484b-bfbd-0badaa769636 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:53.990197 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7966dcc1-24da-484b-bfbd-0badaa769636 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:53.990691 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7966dcc1-24da-484b-bfbd-0badaa769636 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:53.991130 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7966dcc1-24da-484b-bfbd-0badaa769636 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:53.991833 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7966dcc1-24da-484b-bfbd-0badaa769636 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:53.992314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7966dcc1-24da-484b-bfbd-0badaa769636 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:53.992746 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7966dcc1-24da-484b-bfbd-0badaa769636 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:54.120489 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7966dcc1-24da-484b-bfbd-0badaa769636 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:54.128603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7966dcc1-24da-484b-bfbd-0badaa769636 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1319 microversion: 2.1 time: 0.149004 Sep 26 05:32:54.129148 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 259/498] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:53 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:54.719522 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f588612a-30d7-4e63-b944-04398b1ac4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:54.720860 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f588612a-30d7-4e63-b944-04398b1ac4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:54.727940 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f588612a-30d7-4e63-b944-04398b1ac4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:54.728733 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f588612a-30d7-4e63-b944-04398b1ac4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:54.729340 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f588612a-30d7-4e63-b944-04398b1ac4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:54.730045 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f588612a-30d7-4e63-b944-04398b1ac4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:54.730873 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f588612a-30d7-4e63-b944-04398b1ac4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:54.731292 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f588612a-30d7-4e63-b944-04398b1ac4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:54.866371 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f588612a-30d7-4e63-b944-04398b1ac4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:54.874999 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f588612a-30d7-4e63-b944-04398b1ac4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:54.876466 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f588612a-30d7-4e63-b944-04398b1ac4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:54.877618 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f588612a-30d7-4e63-b944-04398b1ac4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.162062 Sep 26 05:32:54.878375 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 240/499] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:54 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:55.151981 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-ab5ea7c0-3578-4ece-ac53-a08cf3388899 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:55.152636 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-ab5ea7c0-3578-4ece-ac53-a08cf3388899 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:55.158597 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ab5ea7c0-3578-4ece-ac53-a08cf3388899 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:55.159725 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ab5ea7c0-3578-4ece-ac53-a08cf3388899 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:55.160176 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ab5ea7c0-3578-4ece-ac53-a08cf3388899 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:55.160888 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ab5ea7c0-3578-4ece-ac53-a08cf3388899 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:55.161339 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ab5ea7c0-3578-4ece-ac53-a08cf3388899 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:55.161763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ab5ea7c0-3578-4ece-ac53-a08cf3388899 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:55.286912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-ab5ea7c0-3578-4ece-ac53-a08cf3388899 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:55.294509 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-ab5ea7c0-3578-4ece-ac53-a08cf3388899 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1319 microversion: 2.1 time: 0.146376 Sep 26 05:32:55.295059 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 260/500] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:55 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:55.903019 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5c1b1a0f-2da2-4b72-acc5-bca2fa68e317 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:55.903629 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5c1b1a0f-2da2-4b72-acc5-bca2fa68e317 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:55.911576 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5c1b1a0f-2da2-4b72-acc5-bca2fa68e317 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:55.912413 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5c1b1a0f-2da2-4b72-acc5-bca2fa68e317 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:55.913004 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5c1b1a0f-2da2-4b72-acc5-bca2fa68e317 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:55.913856 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5c1b1a0f-2da2-4b72-acc5-bca2fa68e317 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:55.914399 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5c1b1a0f-2da2-4b72-acc5-bca2fa68e317 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:55.914851 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5c1b1a0f-2da2-4b72-acc5-bca2fa68e317 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:56.053754 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5c1b1a0f-2da2-4b72-acc5-bca2fa68e317 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:56.062354 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5c1b1a0f-2da2-4b72-acc5-bca2fa68e317 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:56.063788 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5c1b1a0f-2da2-4b72-acc5-bca2fa68e317 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:56.064952 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5c1b1a0f-2da2-4b72-acc5-bca2fa68e317 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.165734 Sep 26 05:32:56.065597 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 241/501] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:55 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:56.317457 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b93edb32-95ef-4e69-9bb4-6134776ca897 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:56.318095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b93edb32-95ef-4e69-9bb4-6134776ca897 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:56.323975 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b93edb32-95ef-4e69-9bb4-6134776ca897 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:56.324487 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b93edb32-95ef-4e69-9bb4-6134776ca897 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:56.324922 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b93edb32-95ef-4e69-9bb4-6134776ca897 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:56.325602 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b93edb32-95ef-4e69-9bb4-6134776ca897 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:56.326054 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b93edb32-95ef-4e69-9bb4-6134776ca897 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:56.326476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b93edb32-95ef-4e69-9bb4-6134776ca897 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:56.452297 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b93edb32-95ef-4e69-9bb4-6134776ca897 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:56.460867 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b93edb32-95ef-4e69-9bb4-6134776ca897 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1319 microversion: 2.1 time: 0.147261 Sep 26 05:32:56.461444 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 261/502] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:56 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:57.090092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7cfce378-f043-494d-bd19-b51cf32f05af tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:57.090693 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7cfce378-f043-494d-bd19-b51cf32f05af tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:57.097525 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7cfce378-f043-494d-bd19-b51cf32f05af tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:57.098006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7cfce378-f043-494d-bd19-b51cf32f05af tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:57.098436 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7cfce378-f043-494d-bd19-b51cf32f05af tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:57.099114 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7cfce378-f043-494d-bd19-b51cf32f05af tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:57.099561 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7cfce378-f043-494d-bd19-b51cf32f05af tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:57.100008 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7cfce378-f043-494d-bd19-b51cf32f05af tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:57.229885 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7cfce378-f043-494d-bd19-b51cf32f05af tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:57.239096 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7cfce378-f043-494d-bd19-b51cf32f05af tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:57.240550 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7cfce378-f043-494d-bd19-b51cf32f05af tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:57.241681 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7cfce378-f043-494d-bd19-b51cf32f05af tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1808 microversion: 2.20 time: 0.155492 Sep 26 05:32:57.242235 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 242/503] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:57 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:57.484389 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3b5ae313-f906-4347-a64d-f133b3723335 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:57.484914 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-3b5ae313-f906-4347-a64d-f133b3723335 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:57.491622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3b5ae313-f906-4347-a64d-f133b3723335 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:57.492105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3b5ae313-f906-4347-a64d-f133b3723335 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:57.492572 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3b5ae313-f906-4347-a64d-f133b3723335 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:57.493259 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3b5ae313-f906-4347-a64d-f133b3723335 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:57.493715 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3b5ae313-f906-4347-a64d-f133b3723335 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:57.494140 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3b5ae313-f906-4347-a64d-f133b3723335 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:57.619621 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-3b5ae313-f906-4347-a64d-f133b3723335 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:57.628624 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-3b5ae313-f906-4347-a64d-f133b3723335 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1319 microversion: 2.1 time: 0.147728 Sep 26 05:32:57.628841 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 262/504] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:57 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:58.267002 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f0b54571-30b4-4497-b5ef-c0fd29fe7755 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:58.267619 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f0b54571-30b4-4497-b5ef-c0fd29fe7755 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:58.274978 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0b54571-30b4-4497-b5ef-c0fd29fe7755 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:58.275566 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0b54571-30b4-4497-b5ef-c0fd29fe7755 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:58.275966 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0b54571-30b4-4497-b5ef-c0fd29fe7755 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:58.276747 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0b54571-30b4-4497-b5ef-c0fd29fe7755 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:58.277245 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0b54571-30b4-4497-b5ef-c0fd29fe7755 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:58.277671 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0b54571-30b4-4497-b5ef-c0fd29fe7755 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:58.404366 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f0b54571-30b4-4497-b5ef-c0fd29fe7755 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:58.413070 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f0b54571-30b4-4497-b5ef-c0fd29fe7755 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:58.414504 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f0b54571-30b4-4497-b5ef-c0fd29fe7755 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:58.415653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f0b54571-30b4-4497-b5ef-c0fd29fe7755 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1795 microversion: 2.20 time: 0.152611 Sep 26 05:32:58.416209 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 243/505] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:32:58 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1795 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:32:58.650941 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5340df20-b598-45c8-8869-a90af2a4853f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:58.651549 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5340df20-b598-45c8-8869-a90af2a4853f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:58.657540 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5340df20-b598-45c8-8869-a90af2a4853f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:58.657954 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5340df20-b598-45c8-8869-a90af2a4853f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:58.658383 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5340df20-b598-45c8-8869-a90af2a4853f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:58.659401 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5340df20-b598-45c8-8869-a90af2a4853f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:58.659903 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5340df20-b598-45c8-8869-a90af2a4853f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:58.660366 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5340df20-b598-45c8-8869-a90af2a4853f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:58.789378 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5340df20-b598-45c8-8869-a90af2a4853f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:58.796928 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5340df20-b598-45c8-8869-a90af2a4853f tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1319 microversion: 2.1 time: 0.149987 Sep 26 05:32:58.797490 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 263/506] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:58 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:32:59.821159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2b1b3b00-094e-457f-b560-059c131e6559 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:32:59.821768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2b1b3b00-094e-457f-b560-059c131e6559 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:32:59.824233 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:59.829658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b1b3b00-094e-457f-b560-059c131e6559 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:59.830136 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b1b3b00-094e-457f-b560-059c131e6559 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:59.830566 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b1b3b00-094e-457f-b560-059c131e6559 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:59.831833 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b1b3b00-094e-457f-b560-059c131e6559 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:32:59.832474 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b1b3b00-094e-457f-b560-059c131e6559 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:32:59.832878 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b1b3b00-094e-457f-b560-059c131e6559 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:32:59.962923 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2b1b3b00-094e-457f-b560-059c131e6559 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:32:59.970562 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2b1b3b00-094e-457f-b560-059c131e6559 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1319 microversion: 2.1 time: 0.153200 Sep 26 05:32:59.971123 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 244/507] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:32:59 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:00.238947 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-185615f3-dbaf-4e04-ad7f-f4c49848f271 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:33:00.240972 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:00.241621 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=6 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:00.247168 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-185615f3-dbaf-4e04-ad7f-f4c49848f271 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:00.247651 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-185615f3-dbaf-4e04-ad7f-f4c49848f271 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:00.248086 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-185615f3-dbaf-4e04-ad7f-f4c49848f271 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:00.308624 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-185615f3-dbaf-4e04-ad7f-f4c49848f271 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Going to try to stop instance {{(pid=120806) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 26 05:33:00.349896 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-185615f3-dbaf-4e04-ad7f-f4c49848f271 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "POST /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47/action" status: 202 len: 0 microversion: 2.1 time: 0.115309 Sep 26 05:33:00.350484 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 264/508] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 05:33:00 2022] POST /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:33:00.358821 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8df6f6c1-3e06-42d3-a804-afc1119f5087 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:00.359433 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8df6f6c1-3e06-42d3-a804-afc1119f5087 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:00.366097 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8df6f6c1-3e06-42d3-a804-afc1119f5087 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:00.366545 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8df6f6c1-3e06-42d3-a804-afc1119f5087 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:00.366981 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8df6f6c1-3e06-42d3-a804-afc1119f5087 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:00.367756 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8df6f6c1-3e06-42d3-a804-afc1119f5087 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:00.368214 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8df6f6c1-3e06-42d3-a804-afc1119f5087 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:00.368654 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8df6f6c1-3e06-42d3-a804-afc1119f5087 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:00.499810 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8df6f6c1-3e06-42d3-a804-afc1119f5087 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:00.509736 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8df6f6c1-3e06-42d3-a804-afc1119f5087 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.155044 Sep 26 05:33:00.510300 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 245/509] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:00 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:00.994105 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-56fc3b52-bbb1-4ee3-9172-eb3a118a7718 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:00.994799 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-56fc3b52-bbb1-4ee3-9172-eb3a118a7718 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:01.001055 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-56fc3b52-bbb1-4ee3-9172-eb3a118a7718 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:01.001555 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-56fc3b52-bbb1-4ee3-9172-eb3a118a7718 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:01.001984 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-56fc3b52-bbb1-4ee3-9172-eb3a118a7718 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:01.002665 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-56fc3b52-bbb1-4ee3-9172-eb3a118a7718 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:01.003197 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-56fc3b52-bbb1-4ee3-9172-eb3a118a7718 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:01.003619 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-56fc3b52-bbb1-4ee3-9172-eb3a118a7718 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:01.130978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-56fc3b52-bbb1-4ee3-9172-eb3a118a7718 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:01.138693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-56fc3b52-bbb1-4ee3-9172-eb3a118a7718 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1319 microversion: 2.1 time: 0.148818 Sep 26 05:33:01.139258 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 265/510] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:00 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:01.393712 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-7afa5448-c9c6-42b8-a084-a779852b0636 req-9bd17689-40ba-429c-afa7-dc951a7d6197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47570062-ca33-436f-ab80-34918ac9c78e", "name": "network-vif-plugged", "status": "completed", "tag": "f45daf39-254f-46e8-9700-adeb9299ab9b"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:33:01.404447 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-7afa5448-c9c6-42b8-a084-a779852b0636 req-9bd17689-40ba-429c-afa7-dc951a7d6197 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:01.404929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-7afa5448-c9c6-42b8-a084-a779852b0636 req-9bd17689-40ba-429c-afa7-dc951a7d6197 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:01.405363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-7afa5448-c9c6-42b8-a084-a779852b0636 req-9bd17689-40ba-429c-afa7-dc951a7d6197 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:01.417936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-7afa5448-c9c6-42b8-a084-a779852b0636 req-9bd17689-40ba-429c-afa7-dc951a7d6197 service nova] Creating event network-vif-plugged:f45daf39-254f-46e8-9700-adeb9299ab9b for instance 47570062-ca33-436f-ab80-34918ac9c78e on hv-cinder-85918 Sep 26 05:33:01.422885 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-7afa5448-c9c6-42b8-a084-a779852b0636 req-9bd17689-40ba-429c-afa7-dc951a7d6197 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033006 Sep 26 05:33:01.423490 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 246/511] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:33:01.532979 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-0ad983cc-c07f-4582-ac82-629907ced4fa tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:01.533544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-0ad983cc-c07f-4582-ac82-629907ced4fa tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:01.540552 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0ad983cc-c07f-4582-ac82-629907ced4fa tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:01.541081 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0ad983cc-c07f-4582-ac82-629907ced4fa tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:01.541726 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0ad983cc-c07f-4582-ac82-629907ced4fa tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:01.542432 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0ad983cc-c07f-4582-ac82-629907ced4fa tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:01.542890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0ad983cc-c07f-4582-ac82-629907ced4fa tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:01.543348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0ad983cc-c07f-4582-ac82-629907ced4fa tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:01.675593 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0ad983cc-c07f-4582-ac82-629907ced4fa tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:01.684724 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-0ad983cc-c07f-4582-ac82-629907ced4fa tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.155648 Sep 26 05:33:01.685328 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 266/512] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:01 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:02.161947 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-69679c37-0e75-41bf-8273-d66d73ab1006 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:02.162592 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-69679c37-0e75-41bf-8273-d66d73ab1006 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:02.168600 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-69679c37-0e75-41bf-8273-d66d73ab1006 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:02.169074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-69679c37-0e75-41bf-8273-d66d73ab1006 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:02.169506 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-69679c37-0e75-41bf-8273-d66d73ab1006 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:02.170184 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-69679c37-0e75-41bf-8273-d66d73ab1006 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:02.170630 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-69679c37-0e75-41bf-8273-d66d73ab1006 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:02.171125 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-69679c37-0e75-41bf-8273-d66d73ab1006 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:02.301858 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-69679c37-0e75-41bf-8273-d66d73ab1006 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:02.309452 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-69679c37-0e75-41bf-8273-d66d73ab1006 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1319 microversion: 2.1 time: 0.152097 Sep 26 05:33:02.310039 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 247/513] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:02 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:02.708927 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-35f03dbb-6ea7-49aa-b49a-416048b892c5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:02.709541 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-35f03dbb-6ea7-49aa-b49a-416048b892c5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:02.715554 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-35f03dbb-6ea7-49aa-b49a-416048b892c5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:02.716037 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-35f03dbb-6ea7-49aa-b49a-416048b892c5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:02.716514 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-35f03dbb-6ea7-49aa-b49a-416048b892c5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:02.717209 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-35f03dbb-6ea7-49aa-b49a-416048b892c5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:02.717666 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-35f03dbb-6ea7-49aa-b49a-416048b892c5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:02.718090 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-35f03dbb-6ea7-49aa-b49a-416048b892c5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:02.843910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-35f03dbb-6ea7-49aa-b49a-416048b892c5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:02.852644 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-35f03dbb-6ea7-49aa-b49a-416048b892c5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.147751 Sep 26 05:33:02.853210 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 267/514] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:02 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:03.332759 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e93910c2-6e01-4e9b-89a8-c9cbb47b52e9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:03.333448 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e93910c2-6e01-4e9b-89a8-c9cbb47b52e9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:03.340636 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e93910c2-6e01-4e9b-89a8-c9cbb47b52e9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:03.341199 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e93910c2-6e01-4e9b-89a8-c9cbb47b52e9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:03.341631 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e93910c2-6e01-4e9b-89a8-c9cbb47b52e9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:03.342308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e93910c2-6e01-4e9b-89a8-c9cbb47b52e9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:03.342753 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e93910c2-6e01-4e9b-89a8-c9cbb47b52e9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:03.343169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e93910c2-6e01-4e9b-89a8-c9cbb47b52e9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:03.474803 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e93910c2-6e01-4e9b-89a8-c9cbb47b52e9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:03.482614 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e93910c2-6e01-4e9b-89a8-c9cbb47b52e9 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1319 microversion: 2.1 time: 0.153652 Sep 26 05:33:03.483172 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 248/515] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:03 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:03.876664 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-29f1df7d-5d22-4272-be66-6c30044d9cf7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:03.877258 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-29f1df7d-5d22-4272-be66-6c30044d9cf7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:03.883548 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-29f1df7d-5d22-4272-be66-6c30044d9cf7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:03.884040 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-29f1df7d-5d22-4272-be66-6c30044d9cf7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:03.884634 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-29f1df7d-5d22-4272-be66-6c30044d9cf7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:03.885363 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-29f1df7d-5d22-4272-be66-6c30044d9cf7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:03.885821 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-29f1df7d-5d22-4272-be66-6c30044d9cf7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:03.886253 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-29f1df7d-5d22-4272-be66-6c30044d9cf7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:04.014991 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-29f1df7d-5d22-4272-be66-6c30044d9cf7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:04.023836 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-29f1df7d-5d22-4272-be66-6c30044d9cf7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.151019 Sep 26 05:33:04.024423 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 268/516] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:03 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:33:04.506277 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c75b81dc-ff1f-4469-ac6c-4f0a3889cc85 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:04.506888 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c75b81dc-ff1f-4469-ac6c-4f0a3889cc85 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:04.513203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c75b81dc-ff1f-4469-ac6c-4f0a3889cc85 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:04.513679 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c75b81dc-ff1f-4469-ac6c-4f0a3889cc85 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:04.514112 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c75b81dc-ff1f-4469-ac6c-4f0a3889cc85 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:04.514785 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c75b81dc-ff1f-4469-ac6c-4f0a3889cc85 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:04.515227 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c75b81dc-ff1f-4469-ac6c-4f0a3889cc85 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:04.515640 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c75b81dc-ff1f-4469-ac6c-4f0a3889cc85 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:04.518277 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:04.648321 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c75b81dc-ff1f-4469-ac6c-4f0a3889cc85 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:04.655849 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c75b81dc-ff1f-4469-ac6c-4f0a3889cc85 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1507 microversion: 2.1 time: 0.153560 Sep 26 05:33:04.656433 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 249/517] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:04 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:04.679024 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b37d52c6-7a04-4d5c-a02b-12e9a87dfc5b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1377b61a-dc16-42f7-8ac6-0fb7485e7002", "device": "/dev/sdb"}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:33:04.681830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b37d52c6-7a04-4d5c-a02b-12e9a87dfc5b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:04.687564 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b37d52c6-7a04-4d5c-a02b-12e9a87dfc5b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:04.688039 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b37d52c6-7a04-4d5c-a02b-12e9a87dfc5b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:04.688506 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b37d52c6-7a04-4d5c-a02b-12e9a87dfc5b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:04.689180 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b37d52c6-7a04-4d5c-a02b-12e9a87dfc5b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:04.689650 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b37d52c6-7a04-4d5c-a02b-12e9a87dfc5b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:04.690068 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b37d52c6-7a04-4d5c-a02b-12e9a87dfc5b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:05.031608 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b37d52c6-7a04-4d5c-a02b-12e9a87dfc5b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "POST /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356502 Sep 26 05:33:05.032298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 269/518] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 05:33:04 2022] POST /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:33:05.046745 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0a10a983-c22f-4394-af2f-1e8034757fac tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:05.047351 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0a10a983-c22f-4394-af2f-1e8034757fac tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:05.054081 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a10a983-c22f-4394-af2f-1e8034757fac tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:05.054561 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a10a983-c22f-4394-af2f-1e8034757fac tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:05.054990 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a10a983-c22f-4394-af2f-1e8034757fac tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:05.055753 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a10a983-c22f-4394-af2f-1e8034757fac tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:05.056200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a10a983-c22f-4394-af2f-1e8034757fac tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:05.056654 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a10a983-c22f-4394-af2f-1e8034757fac tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:05.186493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0a10a983-c22f-4394-af2f-1e8034757fac tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:05.195165 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0a10a983-c22f-4394-af2f-1e8034757fac tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.152219 Sep 26 05:33:05.195731 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 250/519] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:05 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:06.218727 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-93efb6f0-38a0-41b3-ada8-518d59a62394 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:06.219418 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-93efb6f0-38a0-41b3-ada8-518d59a62394 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:06.226774 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-93efb6f0-38a0-41b3-ada8-518d59a62394 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:06.227253 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-93efb6f0-38a0-41b3-ada8-518d59a62394 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:06.227684 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-93efb6f0-38a0-41b3-ada8-518d59a62394 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:06.228390 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-93efb6f0-38a0-41b3-ada8-518d59a62394 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:06.228837 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-93efb6f0-38a0-41b3-ada8-518d59a62394 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:06.229254 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-93efb6f0-38a0-41b3-ada8-518d59a62394 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:06.355502 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-93efb6f0-38a0-41b3-ada8-518d59a62394 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:06.363623 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-93efb6f0-38a0-41b3-ada8-518d59a62394 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.149028 Sep 26 05:33:06.364849 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 270/520] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:06 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:07.387593 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9f18eee9-26e2-4b93-945b-115b3c0ffc53 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:07.388124 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9f18eee9-26e2-4b93-945b-115b3c0ffc53 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:07.390609 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=58 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:07.395783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9f18eee9-26e2-4b93-945b-115b3c0ffc53 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:07.396428 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9f18eee9-26e2-4b93-945b-115b3c0ffc53 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:07.396862 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9f18eee9-26e2-4b93-945b-115b3c0ffc53 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:07.397538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9f18eee9-26e2-4b93-945b-115b3c0ffc53 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:07.397984 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9f18eee9-26e2-4b93-945b-115b3c0ffc53 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:07.398401 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9f18eee9-26e2-4b93-945b-115b3c0ffc53 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:07.527939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9f18eee9-26e2-4b93-945b-115b3c0ffc53 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:07.537124 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9f18eee9-26e2-4b93-945b-115b3c0ffc53 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.153279 Sep 26 05:33:07.537697 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 251/521] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:07 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:08.076663 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-390b6b77-ac26-46c7-a30e-e8a75b426c06 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:08.077217 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-390b6b77-ac26-46c7-a30e-e8a75b426c06 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:08.083680 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-390b6b77-ac26-46c7-a30e-e8a75b426c06 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:08.084169 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-390b6b77-ac26-46c7-a30e-e8a75b426c06 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:08.084639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-390b6b77-ac26-46c7-a30e-e8a75b426c06 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:08.085335 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-390b6b77-ac26-46c7-a30e-e8a75b426c06 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:08.085786 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-390b6b77-ac26-46c7-a30e-e8a75b426c06 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:08.086208 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-390b6b77-ac26-46c7-a30e-e8a75b426c06 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:08.110099 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-390b6b77-ac26-46c7-a30e-e8a75b426c06 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db/ips" status: 200 len: 150 microversion: 2.1 time: 0.037341 Sep 26 05:33:08.110669 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 271/522] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 05:33:08 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:33:08.122897 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5f88fbe4-0d44-4504-916b-6e3b9d0fa8a6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "212e60f4-0cc3-4e97-b6e6-7e5d6ca686c8"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:33:08.125224 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5f88fbe4-0d44-4504-916b-6e3b9d0fa8a6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:08.131236 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f88fbe4-0d44-4504-916b-6e3b9d0fa8a6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:08.131705 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f88fbe4-0d44-4504-916b-6e3b9d0fa8a6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:08.132131 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f88fbe4-0d44-4504-916b-6e3b9d0fa8a6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:08.132837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f88fbe4-0d44-4504-916b-6e3b9d0fa8a6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:08.133283 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f88fbe4-0d44-4504-916b-6e3b9d0fa8a6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:08.133699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f88fbe4-0d44-4504-916b-6e3b9d0fa8a6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:08.219912 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-5f88fbe4-0d44-4504-916b-6e3b9d0fa8a6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] HTTP exception thrown: Invalid volume: volume 212e60f4-0cc3-4e97-b6e6-7e5d6ca686c8 is already attached to instances: 149e1a24-0c3f-4697-8982-771b7bbb4215 Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5f88fbe4-0d44-4504-916b-6e3b9d0fa8a6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Request method failure captured: Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: POST /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db/os-volume_attachments HTTP/1.1 Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 74 Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTi0HNidMJ_uUjz9W9nG4CLXam9AEEcBUxHuJymFks4FVk8X_UREH6vt6sYWIBIpMYwbfop3-Tu9G5rH-U470tWXr7O7oFa6DqY-WLodQcPeOqi33ywVkGIxoXJu-o6j8RNWX3xYPNIu8TNqBir3Si8HbJUdBskNzCM6QioApbM8lh8 Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:33:08.221887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:33:08.223699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd13dd8ec810435491e3f3cba7cca4d1"}]}] Sep 26 05:33:08.223699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:33:08.223699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:33:08.223699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:33:08.223699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:33:08.223699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:33:08.223699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:33:08.223699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 48e588ff6d5a4a37b902abadfb6d04fc Sep 26 05:33:08.223699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:33:08.223699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Sep 26 05:33:08.223699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {"volumeAttachment": {"volumeId": "212e60f4-0cc3-4e97-b6e6-7e5d6ca686c8"}} Sep 26 05:33:08.223699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Invalid volume: volume 212e60f4-0cc3-4e97-b6e6-7e5d6ca686c8 is already attached to instances: 149e1a24-0c3f-4697-8982-771b7bbb4215 Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'server_id': '197dc2cf-12cf-4bf8-8dbd-c05654f127db', 'body': {'volumeAttachment': {'volumeId': '212e60f4-0cc3-4e97-b6e6-7e5d6ca686c8'}}} Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 212e60f4-0cc3-4e97-b6e6-7e5d6ca686c8 is already attached to instances: 149e1a24-0c3f-4697-8982-771b7bbb4215 Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:33:08.224915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 212e60f4-0cc3-4e97-b6e6-7e5d6ca686c8 is already attached to instances: 149e1a24-0c3f-4697-8982-771b7bbb4215 Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:33:08.226058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:33:08.227239 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:33:08.227239 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:33:08.227239 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:33:08.227239 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 212e60f4-0cc3-4e97-b6e6-7e5d6ca686c8 is already attached to instances: 149e1a24-0c3f-4697-8982-771b7bbb4215 Sep 26 05:33:08.227239 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:33:08.227239 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5f88fbe4-0d44-4504-916b-6e3b9d0fa8a6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Returning 400 to user: Invalid volume: volume 212e60f4-0cc3-4e97-b6e6-7e5d6ca686c8 is already attached to instances: 149e1a24-0c3f-4697-8982-771b7bbb4215 {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:33:08.227239 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5f88fbe4-0d44-4504-916b-6e3b9d0fa8a6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "POST /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104369 Sep 26 05:33:08.227239 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 252/523] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 05:33:08 2022] POST /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 05:33:08.233193 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-adcd2a66-5ffa-42e4-b067-ba2fe2735d93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:08.233692 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-adcd2a66-5ffa-42e4-b067-ba2fe2735d93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:08.235686 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:08.242120 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-adcd2a66-5ffa-42e4-b067-ba2fe2735d93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:08.242614 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-adcd2a66-5ffa-42e4-b067-ba2fe2735d93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:08.243048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-adcd2a66-5ffa-42e4-b067-ba2fe2735d93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:08.243738 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-adcd2a66-5ffa-42e4-b067-ba2fe2735d93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:08.244191 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-adcd2a66-5ffa-42e4-b067-ba2fe2735d93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:08.244645 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-adcd2a66-5ffa-42e4-b067-ba2fe2735d93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:08.249160 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:08.271680 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-adcd2a66-5ffa-42e4-b067-ba2fe2735d93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Going to try to terminate instance {{(pid=120806) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:33:08.345827 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-adcd2a66-5ffa-42e4-b067-ba2fe2735d93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "DELETE /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 204 len: 0 microversion: 2.1 time: 0.116473 Sep 26 05:33:08.346577 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 272/524] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:33:08 2022] DELETE /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:33:08.354838 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-01c30c42-82f4-4662-aeec-e6302fce4afa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:08.355953 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-01c30c42-82f4-4662-aeec-e6302fce4afa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:08.362196 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01c30c42-82f4-4662-aeec-e6302fce4afa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:08.362681 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01c30c42-82f4-4662-aeec-e6302fce4afa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:08.363118 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01c30c42-82f4-4662-aeec-e6302fce4afa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:08.363800 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01c30c42-82f4-4662-aeec-e6302fce4afa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:08.364795 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01c30c42-82f4-4662-aeec-e6302fce4afa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:08.365307 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01c30c42-82f4-4662-aeec-e6302fce4afa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:08.493404 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-01c30c42-82f4-4662-aeec-e6302fce4afa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:08.501087 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-01c30c42-82f4-4662-aeec-e6302fce4afa tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1683 microversion: 2.1 time: 0.150250 Sep 26 05:33:08.501639 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 253/525] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:08 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:08.562025 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-481e3696-fa37-43fc-b6c3-427beae6db09 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:08.562726 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-481e3696-fa37-43fc-b6c3-427beae6db09 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:08.569423 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-481e3696-fa37-43fc-b6c3-427beae6db09 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:08.569905 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-481e3696-fa37-43fc-b6c3-427beae6db09 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:08.570340 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-481e3696-fa37-43fc-b6c3-427beae6db09 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:08.571016 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-481e3696-fa37-43fc-b6c3-427beae6db09 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:08.571467 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-481e3696-fa37-43fc-b6c3-427beae6db09 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:08.571891 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-481e3696-fa37-43fc-b6c3-427beae6db09 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:08.701239 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-481e3696-fa37-43fc-b6c3-427beae6db09 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:08.709460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-481e3696-fa37-43fc-b6c3-427beae6db09 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.151696 Sep 26 05:33:08.710019 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 273/526] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:08 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:09.525491 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b73e267e-53ab-4359-8e64-64bb68551d65 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:09.526138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b73e267e-53ab-4359-8e64-64bb68551d65 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:09.535765 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b73e267e-53ab-4359-8e64-64bb68551d65 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:09.536669 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b73e267e-53ab-4359-8e64-64bb68551d65 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:09.537420 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b73e267e-53ab-4359-8e64-64bb68551d65 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:09.538571 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b73e267e-53ab-4359-8e64-64bb68551d65 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:09.539395 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b73e267e-53ab-4359-8e64-64bb68551d65 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:09.539821 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b73e267e-53ab-4359-8e64-64bb68551d65 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:09.665796 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b73e267e-53ab-4359-8e64-64bb68551d65 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:09.673519 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b73e267e-53ab-4359-8e64-64bb68551d65 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1683 microversion: 2.1 time: 0.151872 Sep 26 05:33:09.674078 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 254/527] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:09 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:09.733475 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6f9a903d-da07-41a7-a91b-962bb40e6874 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:09.734192 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6f9a903d-da07-41a7-a91b-962bb40e6874 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:09.740583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6f9a903d-da07-41a7-a91b-962bb40e6874 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:09.741063 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6f9a903d-da07-41a7-a91b-962bb40e6874 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:09.741493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6f9a903d-da07-41a7-a91b-962bb40e6874 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:09.742175 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6f9a903d-da07-41a7-a91b-962bb40e6874 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:09.742621 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6f9a903d-da07-41a7-a91b-962bb40e6874 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:09.743040 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6f9a903d-da07-41a7-a91b-962bb40e6874 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:09.871543 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6f9a903d-da07-41a7-a91b-962bb40e6874 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:09.879708 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6f9a903d-da07-41a7-a91b-962bb40e6874 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.150292 Sep 26 05:33:09.880287 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 274/528] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:09 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:33:10.697172 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-95481067-e320-4436-8879-67c58aa32653 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:10.697788 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-95481067-e320-4436-8879-67c58aa32653 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:10.704229 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95481067-e320-4436-8879-67c58aa32653 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:10.704742 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95481067-e320-4436-8879-67c58aa32653 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:10.705177 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95481067-e320-4436-8879-67c58aa32653 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:10.705860 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95481067-e320-4436-8879-67c58aa32653 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:10.706311 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95481067-e320-4436-8879-67c58aa32653 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:10.706733 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95481067-e320-4436-8879-67c58aa32653 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:10.835148 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-95481067-e320-4436-8879-67c58aa32653 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:10.842825 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-95481067-e320-4436-8879-67c58aa32653 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1683 microversion: 2.1 time: 0.150042 Sep 26 05:33:10.843385 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 255/529] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:10 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:10.903052 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a4b25e41-7494-41d6-87b0-dac84429a02c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:10.903675 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a4b25e41-7494-41d6-87b0-dac84429a02c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:10.910142 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4b25e41-7494-41d6-87b0-dac84429a02c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:10.910630 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4b25e41-7494-41d6-87b0-dac84429a02c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:10.911069 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4b25e41-7494-41d6-87b0-dac84429a02c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:10.911760 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4b25e41-7494-41d6-87b0-dac84429a02c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:10.912218 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4b25e41-7494-41d6-87b0-dac84429a02c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:10.912672 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4b25e41-7494-41d6-87b0-dac84429a02c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:11.039595 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a4b25e41-7494-41d6-87b0-dac84429a02c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:11.047811 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a4b25e41-7494-41d6-87b0-dac84429a02c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.148525 Sep 26 05:33:11.048415 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 275/530] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:10 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:11.868164 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3a883b99-c76c-43a4-beb2-9d347c438565 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:11.868806 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3a883b99-c76c-43a4-beb2-9d347c438565 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:11.875485 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a883b99-c76c-43a4-beb2-9d347c438565 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:11.875935 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a883b99-c76c-43a4-beb2-9d347c438565 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:11.876395 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a883b99-c76c-43a4-beb2-9d347c438565 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:11.877173 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a883b99-c76c-43a4-beb2-9d347c438565 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:11.877618 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a883b99-c76c-43a4-beb2-9d347c438565 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:11.878040 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a883b99-c76c-43a4-beb2-9d347c438565 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:12.020724 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3a883b99-c76c-43a4-beb2-9d347c438565 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:12.028587 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3a883b99-c76c-43a4-beb2-9d347c438565 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1683 microversion: 2.1 time: 0.165595 Sep 26 05:33:12.029151 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 256/531] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:11 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:12.072037 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a1614d33-e8fb-4119-a6d4-ac00c8b82be7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:12.072848 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a1614d33-e8fb-4119-a6d4-ac00c8b82be7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:12.079286 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a1614d33-e8fb-4119-a6d4-ac00c8b82be7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:12.079771 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a1614d33-e8fb-4119-a6d4-ac00c8b82be7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:12.080280 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a1614d33-e8fb-4119-a6d4-ac00c8b82be7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:12.080959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a1614d33-e8fb-4119-a6d4-ac00c8b82be7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:12.081412 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a1614d33-e8fb-4119-a6d4-ac00c8b82be7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:12.081834 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a1614d33-e8fb-4119-a6d4-ac00c8b82be7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:12.213723 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a1614d33-e8fb-4119-a6d4-ac00c8b82be7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:12.222135 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a1614d33-e8fb-4119-a6d4-ac00c8b82be7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.154550 Sep 26 05:33:12.222909 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 276/532] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:12 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:12.765388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-c7a42cf9-ee7f-44cf-8c92-183418cc0312 req-1b0acd69-61a4-4076-aa02-80b33c1e3d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "197dc2cf-12cf-4bf8-8dbd-c05654f127db", "name": "network-vif-deleted", "tag": "319e5cdb-1d81-4b83-b357-3d505b372b72"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:33:12.779085 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-c7a42cf9-ee7f-44cf-8c92-183418cc0312 req-1b0acd69-61a4-4076-aa02-80b33c1e3d65 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:12.779930 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-c7a42cf9-ee7f-44cf-8c92-183418cc0312 req-1b0acd69-61a4-4076-aa02-80b33c1e3d65 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:12.780614 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-c7a42cf9-ee7f-44cf-8c92-183418cc0312 req-1b0acd69-61a4-4076-aa02-80b33c1e3d65 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:12.793437 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-c7a42cf9-ee7f-44cf-8c92-183418cc0312 req-1b0acd69-61a4-4076-aa02-80b33c1e3d65 service nova] Creating event network-vif-deleted:319e5cdb-1d81-4b83-b357-3d505b372b72 for instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db on hv-cinder-85918 Sep 26 05:33:12.806018 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-c7a42cf9-ee7f-44cf-8c92-183418cc0312 req-1b0acd69-61a4-4076-aa02-80b33c1e3d65 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044106 Sep 26 05:33:12.809871 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 257/533] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:33:13.052616 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-ebf8bbb8-1899-404e-8466-f654b9d774d3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:13.053572 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-ebf8bbb8-1899-404e-8466-f654b9d774d3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:13.059760 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ebf8bbb8-1899-404e-8466-f654b9d774d3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:13.060271 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ebf8bbb8-1899-404e-8466-f654b9d774d3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:13.060710 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ebf8bbb8-1899-404e-8466-f654b9d774d3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:13.061407 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ebf8bbb8-1899-404e-8466-f654b9d774d3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:13.061860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ebf8bbb8-1899-404e-8466-f654b9d774d3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:13.062281 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ebf8bbb8-1899-404e-8466-f654b9d774d3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:13.113582 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ebf8bbb8-1899-404e-8466-f654b9d774d3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:13.114130 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ebf8bbb8-1899-404e-8466-f654b9d774d3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:13.114576 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ebf8bbb8-1899-404e-8466-f654b9d774d3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:13.115150 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-ebf8bbb8-1899-404e-8466-f654b9d774d3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lazy-loading 'fault' on Instance uuid 197dc2cf-12cf-4bf8-8dbd-c05654f127db {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:33:13.158207 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-ebf8bbb8-1899-404e-8466-f654b9d774d3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:13.167407 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-ebf8bbb8-1899-404e-8466-f654b9d774d3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 200 len: 1332 microversion: 2.1 time: 0.118606 Sep 26 05:33:13.168010 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 277/534] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:13 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 1332 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:33:13.246717 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6f156331-e8ad-4908-8976-346ac045146b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:13.248838 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6f156331-e8ad-4908-8976-346ac045146b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:13.255358 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f156331-e8ad-4908-8976-346ac045146b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:13.256488 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f156331-e8ad-4908-8976-346ac045146b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:13.257135 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f156331-e8ad-4908-8976-346ac045146b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:13.258026 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f156331-e8ad-4908-8976-346ac045146b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:13.258706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f156331-e8ad-4908-8976-346ac045146b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:13.259334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f156331-e8ad-4908-8976-346ac045146b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:13.409838 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6f156331-e8ad-4908-8976-346ac045146b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:13.419506 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6f156331-e8ad-4908-8976-346ac045146b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.176956 Sep 26 05:33:13.420066 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 258/535] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:13 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:14.191160 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-155ba8f2-f981-4a60-a8a9-127d839c9bca tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:14.191783 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-155ba8f2-f981-4a60-a8a9-127d839c9bca tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:14.198576 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-155ba8f2-f981-4a60-a8a9-127d839c9bca tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:14.199058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-155ba8f2-f981-4a60-a8a9-127d839c9bca tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:14.199493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-155ba8f2-f981-4a60-a8a9-127d839c9bca tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:14.200186 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-155ba8f2-f981-4a60-a8a9-127d839c9bca tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:14.200669 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-155ba8f2-f981-4a60-a8a9-127d839c9bca tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:14.201095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-155ba8f2-f981-4a60-a8a9-127d839c9bca tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:14.215189 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-155ba8f2-f981-4a60-a8a9-127d839c9bca tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] HTTP exception thrown: Instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db could not be found. Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-155ba8f2-f981-4a60-a8a9-127d839c9bca tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Request method failure captured: Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db HTTP/1.1 Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTi0HNidMJ_uUjz9W9nG4CLXam9AEEcBUxHuJymFks4FVk8X_UREH6vt6sYWIBIpMYwbfop3-Tu9G5rH-U470tWXr7O7oFa6DqY-WLodQcPeOqi33ywVkGIxoXJu-o6j8RNWX3xYPNIu8TNqBir3Si8HbJUdBskNzCM6QioApbM8lh8 Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:33:14.216847 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:33:14.218333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd13dd8ec810435491e3f3cba7cca4d1"}]}] Sep 26 05:33:14.218333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:33:14.218333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:33:14.218333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:33:14.218333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:33:14.218333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:33:14.218333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:33:14.218333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 48e588ff6d5a4a37b902abadfb6d04fc Sep 26 05:33:14.218333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:33:14.218333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:33:14.218333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db could not be found. Sep 26 05:33:14.218333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': '197dc2cf-12cf-4bf8-8dbd-c05654f127db'} Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db could not be found. Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:33:14.219241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:33:14.220690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:33:14.220690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:33:14.220690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:33:14.220690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:33:14.220690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:33:14.220690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:33:14.220690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:33:14.220690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db could not be found. Sep 26 05:33:14.220690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:33:14.220690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:33:14.220690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:33:14.220690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:33:14.220690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:33:14.220690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:33:14.220690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:33:14.220690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:33:14.220690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db could not be found. Sep 26 05:33:14.220690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:33:14.222020 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-155ba8f2-f981-4a60-a8a9-127d839c9bca tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Returning 404 to user: Instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:33:14.222020 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-155ba8f2-f981-4a60-a8a9-127d839c9bca tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 404 len: 111 microversion: 2.1 time: 0.031128 Sep 26 05:33:14.222180 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 278/536] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:14 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:33:14.227672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-59fe9c68-2620-4bd8-a4ba-6a35b3bea47c tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '.version_select at 0x7fd7b72b9280>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:14.247538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-59fe9c68-2620-4bd8-a4ba-6a35b3bea47c tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1873336703" status: 202 len: 0 microversion: 2.1 time: 0.024101 Sep 26 05:33:14.248154 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 259/537] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Sep 26 05:33:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1873336703 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:33:14.442159 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b4b9dc36-a365-4e7d-90b2-6b7bd6151e48 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:14.442779 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b4b9dc36-a365-4e7d-90b2-6b7bd6151e48 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:14.449031 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b4b9dc36-a365-4e7d-90b2-6b7bd6151e48 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:14.449518 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b4b9dc36-a365-4e7d-90b2-6b7bd6151e48 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:14.449954 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b4b9dc36-a365-4e7d-90b2-6b7bd6151e48 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:14.450645 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b4b9dc36-a365-4e7d-90b2-6b7bd6151e48 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:14.451099 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b4b9dc36-a365-4e7d-90b2-6b7bd6151e48 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:14.451520 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b4b9dc36-a365-4e7d-90b2-6b7bd6151e48 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:14.660795 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b4b9dc36-a365-4e7d-90b2-6b7bd6151e48 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:14.670069 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b4b9dc36-a365-4e7d-90b2-6b7bd6151e48 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.231963 Sep 26 05:33:14.670641 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 279/538] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:14 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:15.224259 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-16fb6c2c-b140-4d34-9819-2908610e8032 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:15.224778 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-16fb6c2c-b140-4d34-9819-2908610e8032 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:15.230975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-16fb6c2c-b140-4d34-9819-2908610e8032 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:15.231458 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-16fb6c2c-b140-4d34-9819-2908610e8032 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:15.231892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-16fb6c2c-b140-4d34-9819-2908610e8032 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:15.232605 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-16fb6c2c-b140-4d34-9819-2908610e8032 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:15.233054 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-16fb6c2c-b140-4d34-9819-2908610e8032 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:15.233473 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-16fb6c2c-b140-4d34-9819-2908610e8032 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:15.314271 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-16fb6c2c-b140-4d34-9819-2908610e8032 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lazy-loading 'services' on Instance uuid 149e1a24-0c3f-4697-8982-771b7bbb4215 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:33:15.386195 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-16fb6c2c-b140-4d34-9819-2908610e8032 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "DELETE /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments/212e60f4-0cc3-4e97-b6e6-7e5d6ca686c8" status: 202 len: 0 microversion: 2.1 time: 0.166200 Sep 26 05:33:15.386794 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 260/539] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 05:33:15 2022] DELETE /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments/212e60f4-0cc3-4e97-b6e6-7e5d6ca686c8 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:33:15.395147 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b435fb3d-0e72-4b55-bf78-a0ab0a42d74a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:15.398211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b435fb3d-0e72-4b55-bf78-a0ab0a42d74a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:15.404647 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b435fb3d-0e72-4b55-bf78-a0ab0a42d74a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:15.405130 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b435fb3d-0e72-4b55-bf78-a0ab0a42d74a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:15.405570 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b435fb3d-0e72-4b55-bf78-a0ab0a42d74a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:15.406262 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b435fb3d-0e72-4b55-bf78-a0ab0a42d74a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:15.406716 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b435fb3d-0e72-4b55-bf78-a0ab0a42d74a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:15.407143 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b435fb3d-0e72-4b55-bf78-a0ab0a42d74a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:15.436791 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b435fb3d-0e72-4b55-bf78-a0ab0a42d74a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045515 Sep 26 05:33:15.437342 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 280/540] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:33:15 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:33:15.693705 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-12c26c61-ffa4-447a-981b-9b4d73635e1e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:15.694389 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-12c26c61-ffa4-447a-981b-9b4d73635e1e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:15.700530 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12c26c61-ffa4-447a-981b-9b4d73635e1e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:15.701008 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12c26c61-ffa4-447a-981b-9b4d73635e1e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:15.701439 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12c26c61-ffa4-447a-981b-9b4d73635e1e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:15.702140 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12c26c61-ffa4-447a-981b-9b4d73635e1e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:15.702585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12c26c61-ffa4-447a-981b-9b4d73635e1e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:15.703001 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12c26c61-ffa4-447a-981b-9b4d73635e1e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:15.828187 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-12c26c61-ffa4-447a-981b-9b4d73635e1e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:15.837375 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-12c26c61-ffa4-447a-981b-9b4d73635e1e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.148177 Sep 26 05:33:15.837975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 261/541] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:15 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:16.450498 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5ec3a275-f67c-4e63-a900-2590f8034cf1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:16.452722 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5ec3a275-f67c-4e63-a900-2590f8034cf1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:16.459677 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ec3a275-f67c-4e63-a900-2590f8034cf1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:16.460275 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ec3a275-f67c-4e63-a900-2590f8034cf1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:16.460729 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ec3a275-f67c-4e63-a900-2590f8034cf1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:16.461423 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ec3a275-f67c-4e63-a900-2590f8034cf1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:16.461881 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ec3a275-f67c-4e63-a900-2590f8034cf1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:16.462305 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ec3a275-f67c-4e63-a900-2590f8034cf1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:16.491810 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5ec3a275-f67c-4e63-a900-2590f8034cf1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045262 Sep 26 05:33:16.492388 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 281/542] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:33:16 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:33:16.861149 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fa9348ed-595f-4b6d-83c3-5437bc73e1e5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:16.861802 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fa9348ed-595f-4b6d-83c3-5437bc73e1e5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:16.869147 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fa9348ed-595f-4b6d-83c3-5437bc73e1e5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:16.869633 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fa9348ed-595f-4b6d-83c3-5437bc73e1e5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:16.870067 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fa9348ed-595f-4b6d-83c3-5437bc73e1e5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:16.870765 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fa9348ed-595f-4b6d-83c3-5437bc73e1e5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:16.871212 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fa9348ed-595f-4b6d-83c3-5437bc73e1e5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:16.871633 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fa9348ed-595f-4b6d-83c3-5437bc73e1e5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:16.996170 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fa9348ed-595f-4b6d-83c3-5437bc73e1e5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:17.005317 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fa9348ed-595f-4b6d-83c3-5437bc73e1e5 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.148082 Sep 26 05:33:17.005912 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 262/543] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:16 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:17.503658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d7f3a23c-a868-4afa-9374-47c96f2dd57f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:17.506507 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d7f3a23c-a868-4afa-9374-47c96f2dd57f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:17.512990 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d7f3a23c-a868-4afa-9374-47c96f2dd57f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:17.513471 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d7f3a23c-a868-4afa-9374-47c96f2dd57f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:17.513896 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d7f3a23c-a868-4afa-9374-47c96f2dd57f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:17.514579 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d7f3a23c-a868-4afa-9374-47c96f2dd57f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:17.515027 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d7f3a23c-a868-4afa-9374-47c96f2dd57f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:17.515440 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d7f3a23c-a868-4afa-9374-47c96f2dd57f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:17.543751 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d7f3a23c-a868-4afa-9374-47c96f2dd57f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044043 Sep 26 05:33:17.544305 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 282/544] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:33:17 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:33:18.029054 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9c98c47d-058f-4440-904c-f00e96ebe385 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:18.029666 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9c98c47d-058f-4440-904c-f00e96ebe385 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:18.036031 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9c98c47d-058f-4440-904c-f00e96ebe385 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:18.037949 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9c98c47d-058f-4440-904c-f00e96ebe385 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:18.038411 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9c98c47d-058f-4440-904c-f00e96ebe385 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:18.039300 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9c98c47d-058f-4440-904c-f00e96ebe385 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:18.039753 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9c98c47d-058f-4440-904c-f00e96ebe385 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:18.040172 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9c98c47d-058f-4440-904c-f00e96ebe385 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:18.184059 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9c98c47d-058f-4440-904c-f00e96ebe385 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:18.192488 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9c98c47d-058f-4440-904c-f00e96ebe385 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.167238 Sep 26 05:33:18.193320 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 263/545] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:18 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:18.557116 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e23d4575-1919-4c20-b2b5-04c7b90d4dee tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:18.559235 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e23d4575-1919-4c20-b2b5-04c7b90d4dee tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:18.565598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e23d4575-1919-4c20-b2b5-04c7b90d4dee tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:18.566065 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e23d4575-1919-4c20-b2b5-04c7b90d4dee tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:18.566507 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e23d4575-1919-4c20-b2b5-04c7b90d4dee tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:18.567180 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e23d4575-1919-4c20-b2b5-04c7b90d4dee tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:18.567623 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e23d4575-1919-4c20-b2b5-04c7b90d4dee tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:18.568130 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e23d4575-1919-4c20-b2b5-04c7b90d4dee tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:18.597239 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e23d4575-1919-4c20-b2b5-04c7b90d4dee tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044805 Sep 26 05:33:18.597794 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 283/546] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:33:18 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:33:19.214742 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-af5677cb-1a17-43f5-9d4d-cd06b4e8bac8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:19.215347 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-af5677cb-1a17-43f5-9d4d-cd06b4e8bac8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:19.221677 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-af5677cb-1a17-43f5-9d4d-cd06b4e8bac8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:19.222156 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-af5677cb-1a17-43f5-9d4d-cd06b4e8bac8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:19.222584 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-af5677cb-1a17-43f5-9d4d-cd06b4e8bac8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:19.223385 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-af5677cb-1a17-43f5-9d4d-cd06b4e8bac8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:19.224382 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-af5677cb-1a17-43f5-9d4d-cd06b4e8bac8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:19.224770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-af5677cb-1a17-43f5-9d4d-cd06b4e8bac8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:19.352182 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-af5677cb-1a17-43f5-9d4d-cd06b4e8bac8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:19.360630 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-af5677cb-1a17-43f5-9d4d-cd06b4e8bac8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.149636 Sep 26 05:33:19.361193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 264/547] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:19 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:19.611101 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a97ebf6f-4e4a-4a76-86b3-3d7261da21de tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:19.613216 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a97ebf6f-4e4a-4a76-86b3-3d7261da21de tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:19.619562 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a97ebf6f-4e4a-4a76-86b3-3d7261da21de tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:19.620041 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a97ebf6f-4e4a-4a76-86b3-3d7261da21de tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:19.620503 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a97ebf6f-4e4a-4a76-86b3-3d7261da21de tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:19.621180 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a97ebf6f-4e4a-4a76-86b3-3d7261da21de tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:19.621623 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a97ebf6f-4e4a-4a76-86b3-3d7261da21de tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:19.622042 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a97ebf6f-4e4a-4a76-86b3-3d7261da21de tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:19.650729 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a97ebf6f-4e4a-4a76-86b3-3d7261da21de tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043677 Sep 26 05:33:19.651271 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 284/548] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:33:19 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:33:20.383553 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-da415d92-33b1-4e7a-9ab2-fc2097a87602 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:20.384163 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-da415d92-33b1-4e7a-9ab2-fc2097a87602 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:20.390593 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-da415d92-33b1-4e7a-9ab2-fc2097a87602 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:20.391081 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-da415d92-33b1-4e7a-9ab2-fc2097a87602 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:20.391514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-da415d92-33b1-4e7a-9ab2-fc2097a87602 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:20.392199 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-da415d92-33b1-4e7a-9ab2-fc2097a87602 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:20.392675 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-da415d92-33b1-4e7a-9ab2-fc2097a87602 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:20.393097 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-da415d92-33b1-4e7a-9ab2-fc2097a87602 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:20.521857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-da415d92-33b1-4e7a-9ab2-fc2097a87602 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:20.530063 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-da415d92-33b1-4e7a-9ab2-fc2097a87602 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.151142 Sep 26 05:33:20.530631 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 265/549] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:20 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:20.662701 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5853f816-1af1-40d7-9e26-f910fe55dfc3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:20.664831 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5853f816-1af1-40d7-9e26-f910fe55dfc3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:20.671179 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5853f816-1af1-40d7-9e26-f910fe55dfc3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:20.671659 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5853f816-1af1-40d7-9e26-f910fe55dfc3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:20.672095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5853f816-1af1-40d7-9e26-f910fe55dfc3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:20.672809 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5853f816-1af1-40d7-9e26-f910fe55dfc3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:20.673261 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5853f816-1af1-40d7-9e26-f910fe55dfc3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:20.673681 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5853f816-1af1-40d7-9e26-f910fe55dfc3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:20.703407 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5853f816-1af1-40d7-9e26-f910fe55dfc3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044805 Sep 26 05:33:20.703959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 285/550] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:33:20 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:33:21.553471 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-95765e4c-24a8-4c77-a4c2-014f2ac7761a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:21.554092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-95765e4c-24a8-4c77-a4c2-014f2ac7761a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:21.560603 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95765e4c-24a8-4c77-a4c2-014f2ac7761a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:21.561087 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95765e4c-24a8-4c77-a4c2-014f2ac7761a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:21.561523 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95765e4c-24a8-4c77-a4c2-014f2ac7761a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:21.562214 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95765e4c-24a8-4c77-a4c2-014f2ac7761a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:21.562669 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95765e4c-24a8-4c77-a4c2-014f2ac7761a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:21.563096 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95765e4c-24a8-4c77-a4c2-014f2ac7761a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:21.688718 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-95765e4c-24a8-4c77-a4c2-014f2ac7761a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:21.691037 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:21.699358 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-95765e4c-24a8-4c77-a4c2-014f2ac7761a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.149955 Sep 26 05:33:21.699925 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 266/551] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:21 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:21.715472 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-2e5f9214-afd0-403f-983c-3547b57ba826 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:21.717697 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-2e5f9214-afd0-403f-983c-3547b57ba826 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:21.724540 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2e5f9214-afd0-403f-983c-3547b57ba826 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:21.724997 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2e5f9214-afd0-403f-983c-3547b57ba826 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:21.725441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2e5f9214-afd0-403f-983c-3547b57ba826 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:21.726127 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2e5f9214-afd0-403f-983c-3547b57ba826 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:21.726579 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2e5f9214-afd0-403f-983c-3547b57ba826 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:21.727002 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2e5f9214-afd0-403f-983c-3547b57ba826 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:21.758981 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2e5f9214-afd0-403f-983c-3547b57ba826 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047443 Sep 26 05:33:21.759531 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 286/552] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:33:21 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:33:22.723155 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-30965cc1-9671-4a1a-b836-3e236d315619 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:22.724465 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-30965cc1-9671-4a1a-b836-3e236d315619 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:22.731667 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30965cc1-9671-4a1a-b836-3e236d315619 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:22.732143 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30965cc1-9671-4a1a-b836-3e236d315619 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:22.732604 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30965cc1-9671-4a1a-b836-3e236d315619 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:22.733279 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30965cc1-9671-4a1a-b836-3e236d315619 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:22.733727 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30965cc1-9671-4a1a-b836-3e236d315619 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:22.734143 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30965cc1-9671-4a1a-b836-3e236d315619 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:22.771717 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5969ef71-2971-4412-b80a-029aa312c0b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:22.774079 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5969ef71-2971-4412-b80a-029aa312c0b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:22.780772 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5969ef71-2971-4412-b80a-029aa312c0b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:22.781263 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5969ef71-2971-4412-b80a-029aa312c0b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:22.781698 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5969ef71-2971-4412-b80a-029aa312c0b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:22.782429 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5969ef71-2971-4412-b80a-029aa312c0b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:22.782879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5969ef71-2971-4412-b80a-029aa312c0b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:22.793675 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5969ef71-2971-4412-b80a-029aa312c0b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:22.815056 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:22.830337 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5969ef71-2971-4412-b80a-029aa312c0b8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062952 Sep 26 05:33:22.830919 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 287/553] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:33:22 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 26 05:33:22.881801 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-30965cc1-9671-4a1a-b836-3e236d315619 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:22.890277 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-30965cc1-9671-4a1a-b836-3e236d315619 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.171010 Sep 26 05:33:22.890844 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 267/554] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:22 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:22.897217 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9300b8f7-5f1f-45ad-87fc-ea65c04608a3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:22.897758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-9300b8f7-5f1f-45ad-87fc-ea65c04608a3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:22.903977 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9300b8f7-5f1f-45ad-87fc-ea65c04608a3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:22.904503 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9300b8f7-5f1f-45ad-87fc-ea65c04608a3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:22.904932 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9300b8f7-5f1f-45ad-87fc-ea65c04608a3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:22.905613 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9300b8f7-5f1f-45ad-87fc-ea65c04608a3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:22.906058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9300b8f7-5f1f-45ad-87fc-ea65c04608a3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:22.906504 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9300b8f7-5f1f-45ad-87fc-ea65c04608a3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:22.933183 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-9300b8f7-5f1f-45ad-87fc-ea65c04608a3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Going to try to terminate instance {{(pid=120806) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:33:23.007383 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-9300b8f7-5f1f-45ad-87fc-ea65c04608a3 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "DELETE /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 204 len: 0 microversion: 2.1 time: 0.114220 Sep 26 05:33:23.007867 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 288/555] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:33:22 2022] DELETE /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:33:23.015903 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c92ec018-9f74-477c-9359-1022aac98262 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:23.016545 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c92ec018-9f74-477c-9359-1022aac98262 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:23.022912 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c92ec018-9f74-477c-9359-1022aac98262 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:23.023398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c92ec018-9f74-477c-9359-1022aac98262 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:23.023835 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c92ec018-9f74-477c-9359-1022aac98262 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:23.024565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c92ec018-9f74-477c-9359-1022aac98262 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:23.025013 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c92ec018-9f74-477c-9359-1022aac98262 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:23.025435 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c92ec018-9f74-477c-9359-1022aac98262 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:23.157485 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c92ec018-9f74-477c-9359-1022aac98262 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:23.165752 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c92ec018-9f74-477c-9359-1022aac98262 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1679 microversion: 2.1 time: 0.153667 Sep 26 05:33:23.166306 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 268/556] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:23 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:23.916193 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-33194dfd-3ed7-439d-83d6-475f77683cea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:23.916930 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-33194dfd-3ed7-439d-83d6-475f77683cea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:23.923266 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-33194dfd-3ed7-439d-83d6-475f77683cea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:23.923745 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-33194dfd-3ed7-439d-83d6-475f77683cea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:23.924178 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-33194dfd-3ed7-439d-83d6-475f77683cea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:23.924890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-33194dfd-3ed7-439d-83d6-475f77683cea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:23.925344 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-33194dfd-3ed7-439d-83d6-475f77683cea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:23.925765 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-33194dfd-3ed7-439d-83d6-475f77683cea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:24.060850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-33194dfd-3ed7-439d-83d6-475f77683cea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:24.068901 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-33194dfd-3ed7-439d-83d6-475f77683cea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.157771 Sep 26 05:33:24.069464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 289/557] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:23 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:24.188542 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2e7177d6-afaf-48f3-adfb-d28616856438 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:24.189156 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2e7177d6-afaf-48f3-adfb-d28616856438 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:24.195671 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7177d6-afaf-48f3-adfb-d28616856438 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:24.196152 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7177d6-afaf-48f3-adfb-d28616856438 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:24.196618 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7177d6-afaf-48f3-adfb-d28616856438 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:24.197305 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7177d6-afaf-48f3-adfb-d28616856438 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:24.197756 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7177d6-afaf-48f3-adfb-d28616856438 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:24.198180 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7177d6-afaf-48f3-adfb-d28616856438 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:24.325777 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2e7177d6-afaf-48f3-adfb-d28616856438 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:24.334009 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2e7177d6-afaf-48f3-adfb-d28616856438 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1679 microversion: 2.1 time: 0.149304 Sep 26 05:33:24.334574 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 269/558] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:24 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:25.092703 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e8512864-197c-4ab5-8644-b1f5f65b6642 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:25.093300 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e8512864-197c-4ab5-8644-b1f5f65b6642 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:25.099673 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e8512864-197c-4ab5-8644-b1f5f65b6642 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:25.100156 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e8512864-197c-4ab5-8644-b1f5f65b6642 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:25.100628 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e8512864-197c-4ab5-8644-b1f5f65b6642 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:25.101313 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e8512864-197c-4ab5-8644-b1f5f65b6642 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:25.101764 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e8512864-197c-4ab5-8644-b1f5f65b6642 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:25.102185 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e8512864-197c-4ab5-8644-b1f5f65b6642 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:25.243765 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e8512864-197c-4ab5-8644-b1f5f65b6642 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:25.252038 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e8512864-197c-4ab5-8644-b1f5f65b6642 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.163162 Sep 26 05:33:25.252718 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 290/559] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:25 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:25.358726 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0e1e0e5e-58e5-4c7a-b192-bc3984565687 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:25.359307 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0e1e0e5e-58e5-4c7a-b192-bc3984565687 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:25.366553 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0e1e0e5e-58e5-4c7a-b192-bc3984565687 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:25.367031 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0e1e0e5e-58e5-4c7a-b192-bc3984565687 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:25.367465 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0e1e0e5e-58e5-4c7a-b192-bc3984565687 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:25.368147 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0e1e0e5e-58e5-4c7a-b192-bc3984565687 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:25.368630 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0e1e0e5e-58e5-4c7a-b192-bc3984565687 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:25.369051 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0e1e0e5e-58e5-4c7a-b192-bc3984565687 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:25.509175 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0e1e0e5e-58e5-4c7a-b192-bc3984565687 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:25.516792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0e1e0e5e-58e5-4c7a-b192-bc3984565687 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1679 microversion: 2.1 time: 0.162263 Sep 26 05:33:25.517363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 270/560] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:25 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:26.276086 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f71d0919-811a-44cf-9b6f-2fbfb65d5c35 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:26.276840 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f71d0919-811a-44cf-9b6f-2fbfb65d5c35 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:26.284376 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f71d0919-811a-44cf-9b6f-2fbfb65d5c35 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:26.284865 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f71d0919-811a-44cf-9b6f-2fbfb65d5c35 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:26.285474 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f71d0919-811a-44cf-9b6f-2fbfb65d5c35 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:26.286173 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f71d0919-811a-44cf-9b6f-2fbfb65d5c35 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:26.286652 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f71d0919-811a-44cf-9b6f-2fbfb65d5c35 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:26.287141 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f71d0919-811a-44cf-9b6f-2fbfb65d5c35 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:26.519722 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f71d0919-811a-44cf-9b6f-2fbfb65d5c35 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:26.528326 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f71d0919-811a-44cf-9b6f-2fbfb65d5c35 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.257014 Sep 26 05:33:26.528885 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 291/561] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:26 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:26.541400 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-dcc00622-5390-4dfa-954e-d87a1ecbd93c tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:26.542011 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-dcc00622-5390-4dfa-954e-d87a1ecbd93c tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:26.548912 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcc00622-5390-4dfa-954e-d87a1ecbd93c tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:26.549386 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcc00622-5390-4dfa-954e-d87a1ecbd93c tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:26.549821 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcc00622-5390-4dfa-954e-d87a1ecbd93c tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:26.550489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcc00622-5390-4dfa-954e-d87a1ecbd93c tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:26.550933 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcc00622-5390-4dfa-954e-d87a1ecbd93c tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:26.551352 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcc00622-5390-4dfa-954e-d87a1ecbd93c tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:26.612970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c066ae31-29d2-47cf-9698-765be942053b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:26.613554 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c066ae31-29d2-47cf-9698-765be942053b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:26.620209 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c066ae31-29d2-47cf-9698-765be942053b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:26.620741 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c066ae31-29d2-47cf-9698-765be942053b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:26.621243 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c066ae31-29d2-47cf-9698-765be942053b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:26.622020 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c066ae31-29d2-47cf-9698-765be942053b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:26.622535 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c066ae31-29d2-47cf-9698-765be942053b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:26.623018 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c066ae31-29d2-47cf-9698-765be942053b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:26.648021 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-dcc00622-5390-4dfa-954e-d87a1ecbd93c tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:26.657434 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-dcc00622-5390-4dfa-954e-d87a1ecbd93c tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1611 microversion: 2.1 time: 0.120083 Sep 26 05:33:26.674628 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 271/562] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:26 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1611 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:26.726514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-76d341a1-b81f-44a6-9eb3-0f0f53f07447 req-f25ada37-5bea-43aa-b68e-cef3bebbe118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149e1a24-0c3f-4697-8982-771b7bbb4215", "name": "network-vif-deleted", "tag": "61f405ec-53a2-45d3-97e1-b2c513f8244a"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:33:26.736940 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-76d341a1-b81f-44a6-9eb3-0f0f53f07447 req-f25ada37-5bea-43aa-b68e-cef3bebbe118 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:26.737562 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-76d341a1-b81f-44a6-9eb3-0f0f53f07447 req-f25ada37-5bea-43aa-b68e-cef3bebbe118 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:26.738101 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-76d341a1-b81f-44a6-9eb3-0f0f53f07447 req-f25ada37-5bea-43aa-b68e-cef3bebbe118 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:26.766688 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-76d341a1-b81f-44a6-9eb3-0f0f53f07447 req-f25ada37-5bea-43aa-b68e-cef3bebbe118 service nova] Creating event network-vif-deleted:61f405ec-53a2-45d3-97e1-b2c513f8244a for instance 149e1a24-0c3f-4697-8982-771b7bbb4215 on hv-cinder-85918 Sep 26 05:33:26.773058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-76d341a1-b81f-44a6-9eb3-0f0f53f07447 req-f25ada37-5bea-43aa-b68e-cef3bebbe118 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050430 Sep 26 05:33:26.774054 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 272/563] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:33:26.799706 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-c066ae31-29d2-47cf-9698-765be942053b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lazy-loading 'services' on Instance uuid 47570062-ca33-436f-ab80-34918ac9c78e {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:33:26.951186 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c066ae31-29d2-47cf-9698-765be942053b tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "DELETE /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e/os-volume_attachments/1377b61a-dc16-42f7-8ac6-0fb7485e7002" status: 202 len: 0 microversion: 2.1 time: 0.342012 Sep 26 05:33:26.951856 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 292/564] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 05:33:26 2022] DELETE /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e/os-volume_attachments/1377b61a-dc16-42f7-8ac6-0fb7485e7002 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 05:33:27.553312 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d66cfe7e-dd7f-4899-9622-a739e9f19a2d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:27.554502 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d66cfe7e-dd7f-4899-9622-a739e9f19a2d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:27.560687 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d66cfe7e-dd7f-4899-9622-a739e9f19a2d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:27.561171 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d66cfe7e-dd7f-4899-9622-a739e9f19a2d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:27.561606 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d66cfe7e-dd7f-4899-9622-a739e9f19a2d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:27.562293 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d66cfe7e-dd7f-4899-9622-a739e9f19a2d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:27.562745 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d66cfe7e-dd7f-4899-9622-a739e9f19a2d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:27.563166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d66cfe7e-dd7f-4899-9622-a739e9f19a2d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:27.683047 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-4f411627-4e93-42b0-a62b-8394bba92458 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:27.683755 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-4f411627-4e93-42b0-a62b-8394bba92458 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:27.702456 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4f411627-4e93-42b0-a62b-8394bba92458 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:27.702626 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4f411627-4e93-42b0-a62b-8394bba92458 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:27.703080 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4f411627-4e93-42b0-a62b-8394bba92458 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:27.704022 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4f411627-4e93-42b0-a62b-8394bba92458 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:27.704275 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4f411627-4e93-42b0-a62b-8394bba92458 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:27.704699 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4f411627-4e93-42b0-a62b-8394bba92458 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:27.711370 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d66cfe7e-dd7f-4899-9622-a739e9f19a2d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:27.720100 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d66cfe7e-dd7f-4899-9622-a739e9f19a2d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1724 microversion: 2.1 time: 0.171632 Sep 26 05:33:27.720980 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 273/565] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:27 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:27.744515 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4f411627-4e93-42b0-a62b-8394bba92458 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:27.744992 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4f411627-4e93-42b0-a62b-8394bba92458 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:27.745425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4f411627-4e93-42b0-a62b-8394bba92458 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:27.745869 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-4f411627-4e93-42b0-a62b-8394bba92458 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lazy-loading 'fault' on Instance uuid 149e1a24-0c3f-4697-8982-771b7bbb4215 {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:33:27.789569 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-4f411627-4e93-42b0-a62b-8394bba92458 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:27.797786 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-4f411627-4e93-42b0-a62b-8394bba92458 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 200 len: 1330 microversion: 2.1 time: 0.119872 Sep 26 05:33:27.798887 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 293/566] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:27 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 1330 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:33:28.744489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4c642d38-8461-4071-b275-e9631681af90 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:28.745096 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4c642d38-8461-4071-b275-e9631681af90 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:28.751489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c642d38-8461-4071-b275-e9631681af90 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:28.751970 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c642d38-8461-4071-b275-e9631681af90 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:28.752435 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c642d38-8461-4071-b275-e9631681af90 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:28.753115 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c642d38-8461-4071-b275-e9631681af90 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:28.753562 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c642d38-8461-4071-b275-e9631681af90 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:28.753985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c642d38-8461-4071-b275-e9631681af90 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:28.823232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-52432642-df9e-4f25-b40c-51e66ca14f07 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:28.823841 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-52432642-df9e-4f25-b40c-51e66ca14f07 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:28.830155 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-52432642-df9e-4f25-b40c-51e66ca14f07 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:28.830758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-52432642-df9e-4f25-b40c-51e66ca14f07 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:28.831050 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-52432642-df9e-4f25-b40c-51e66ca14f07 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:28.831740 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-52432642-df9e-4f25-b40c-51e66ca14f07 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:28.832184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-52432642-df9e-4f25-b40c-51e66ca14f07 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:28.832641 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-52432642-df9e-4f25-b40c-51e66ca14f07 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:28.846748 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-52432642-df9e-4f25-b40c-51e66ca14f07 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] HTTP exception thrown: Instance 149e1a24-0c3f-4697-8982-771b7bbb4215 could not be found. Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-52432642-df9e-4f25-b40c-51e66ca14f07 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Request method failure captured: Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 HTTP/1.1 Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTi0HNidMJ_uUjz9W9nG4CLXam9AEEcBUxHuJymFks4FVk8X_UREH6vt6sYWIBIpMYwbfop3-Tu9G5rH-U470tWXr7O7oFa6DqY-WLodQcPeOqi33ywVkGIxoXJu-o6j8RNWX3xYPNIu8TNqBir3Si8HbJUdBskNzCM6QioApbM8lh8 Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:33:28.848452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:33:28.849872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd13dd8ec810435491e3f3cba7cca4d1"}]}] Sep 26 05:33:28.849872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:33:28.849872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:33:28.849872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:33:28.849872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:33:28.849872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:33:28.849872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:33:28.849872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 48e588ff6d5a4a37b902abadfb6d04fc Sep 26 05:33:28.849872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:33:28.849872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:33:28.849872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance 149e1a24-0c3f-4697-8982-771b7bbb4215 could not be found. Sep 26 05:33:28.849872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': '149e1a24-0c3f-4697-8982-771b7bbb4215'} Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149e1a24-0c3f-4697-8982-771b7bbb4215 could not be found. Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:33:28.850660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:33:28.852219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:33:28.852219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:33:28.852219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:33:28.852219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:33:28.852219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:33:28.852219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:33:28.852219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:33:28.852219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149e1a24-0c3f-4697-8982-771b7bbb4215 could not be found. Sep 26 05:33:28.852219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:33:28.852219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:33:28.852219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:33:28.852219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:33:28.852219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:33:28.852219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:33:28.852219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:33:28.852219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:33:28.852219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149e1a24-0c3f-4697-8982-771b7bbb4215 could not be found. Sep 26 05:33:28.852219 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:33:28.853906 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-52432642-df9e-4f25-b40c-51e66ca14f07 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Returning 404 to user: Instance 149e1a24-0c3f-4697-8982-771b7bbb4215 could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:33:28.853906 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-52432642-df9e-4f25-b40c-51e66ca14f07 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 404 len: 111 microversion: 2.1 time: 0.030478 Sep 26 05:33:28.853906 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 294/567] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:28 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:33:28.858581 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7a8268b5-077e-4968-80df-0e6259e5906e tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '.version_select at 0x7fd7b737c5e0>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:28.879432 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7a8268b5-077e-4968-80df-0e6259e5906e tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-245433757" status: 202 len: 0 microversion: 2.1 time: 0.024523 Sep 26 05:33:28.879990 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 295/568] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Sep 26 05:33:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-245433757 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:33:28.888399 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4c642d38-8461-4071-b275-e9631681af90 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:28.896938 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4c642d38-8461-4071-b275-e9631681af90 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1701 microversion: 2.1 time: 0.157008 Sep 26 05:33:28.897553 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 274/569] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:28 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1701 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:28.920331 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5f4e37f7-4b5b-46db-b664-a3d3164b7ad3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:33:28.927183 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f4e37f7-4b5b-46db-b664-a3d3164b7ad3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:28.928293 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f4e37f7-4b5b-46db-b664-a3d3164b7ad3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:28.928936 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f4e37f7-4b5b-46db-b664-a3d3164b7ad3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:28.950923 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5f4e37f7-4b5b-46db-b664-a3d3164b7ad3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Going to try to start instance {{(pid=120806) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 26 05:33:28.993762 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5f4e37f7-4b5b-46db-b664-a3d3164b7ad3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "POST /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47/action" status: 202 len: 0 microversion: 2.1 time: 0.077238 Sep 26 05:33:28.994572 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 296/570] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 05:33:28 2022] POST /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:33:29.002582 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3a35c15b-be5e-4d2f-8a18-73bb6b812f95 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:29.003617 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3a35c15b-be5e-4d2f-8a18-73bb6b812f95 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:29.011877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a35c15b-be5e-4d2f-8a18-73bb6b812f95 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:29.012634 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a35c15b-be5e-4d2f-8a18-73bb6b812f95 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:29.013179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a35c15b-be5e-4d2f-8a18-73bb6b812f95 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:29.013912 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a35c15b-be5e-4d2f-8a18-73bb6b812f95 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:29.014565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a35c15b-be5e-4d2f-8a18-73bb6b812f95 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:29.015178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a35c15b-be5e-4d2f-8a18-73bb6b812f95 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:29.168491 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-96f39036-2eb7-49f9-a838-c5b7f0d80a68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:29.169147 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-96f39036-2eb7-49f9-a838-c5b7f0d80a68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:29.175691 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-96f39036-2eb7-49f9-a838-c5b7f0d80a68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:29.176117 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-96f39036-2eb7-49f9-a838-c5b7f0d80a68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:29.176581 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-96f39036-2eb7-49f9-a838-c5b7f0d80a68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:29.177284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-96f39036-2eb7-49f9-a838-c5b7f0d80a68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:29.178341 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-96f39036-2eb7-49f9-a838-c5b7f0d80a68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:29.179086 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-96f39036-2eb7-49f9-a838-c5b7f0d80a68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:29.211785 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-96f39036-2eb7-49f9-a838-c5b7f0d80a68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Going to try to terminate instance {{(pid=120806) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:33:29.217060 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3a35c15b-be5e-4d2f-8a18-73bb6b812f95 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:29.226195 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3a35c15b-be5e-4d2f-8a18-73bb6b812f95 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1710 microversion: 2.1 time: 0.227622 Sep 26 05:33:29.227234 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 275/571] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:28 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1710 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:29.306134 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-96f39036-2eb7-49f9-a838-c5b7f0d80a68 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "DELETE /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 204 len: 0 microversion: 2.1 time: 0.144823 Sep 26 05:33:29.307542 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 297/572] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:33:29 2022] DELETE /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 05:33:29.317318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e528856c-07ca-44a9-9be8-9bf0a46a2df5 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:29.318022 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e528856c-07ca-44a9-9be8-9bf0a46a2df5 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:29.324874 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e528856c-07ca-44a9-9be8-9bf0a46a2df5 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:29.325425 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e528856c-07ca-44a9-9be8-9bf0a46a2df5 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:29.325946 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e528856c-07ca-44a9-9be8-9bf0a46a2df5 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:29.326705 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e528856c-07ca-44a9-9be8-9bf0a46a2df5 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:29.327229 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e528856c-07ca-44a9-9be8-9bf0a46a2df5 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:29.327710 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e528856c-07ca-44a9-9be8-9bf0a46a2df5 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:29.461704 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e528856c-07ca-44a9-9be8-9bf0a46a2df5 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:29.469547 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e528856c-07ca-44a9-9be8-9bf0a46a2df5 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1513 microversion: 2.1 time: 0.157777 Sep 26 05:33:29.470109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 276/573] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:29 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:29.563202 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f107a7b6-a1de-4a3b-97de-f1c1b3b2ee43 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Action: 'create', calling method: .version_select at 0x7fd7b726d4c0>, body: {"keypair": {"name": "tempest-keypair-1549388733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCQF7QWB11ygctiYywi6z2bTaUNXZ8FNpqQKb7rLEnOn/TdKOIhyH8BTuSG0ofLc7fOwPytcV2OIryHs3zBoucn7R4vj8+lYi95Dsjaex0xML+XkQF1moPM/paR4uN2Wg=="}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:33:29.579181 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-f107a7b6-a1de-4a3b-97de-f1c1b3b2ee43 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Getting quotas for project fd13dd8ec810435491e3f3cba7cca4d1. Resources: {'key_pairs'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:33:29.583044 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-f107a7b6-a1de-4a3b-97de-f1c1b3b2ee43 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Getting quotas for user 48e588ff6d5a4a37b902abadfb6d04fc and project fd13dd8ec810435491e3f3cba7cca4d1. Resources: {'key_pairs'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:33:29.604780 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f107a7b6-a1de-4a3b-97de-f1c1b3b2ee43 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045612 Sep 26 05:33:29.605383 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 298/574] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 05:33:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:33:30.251084 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-98d774a0-0e32-4771-a45c-f9146e7acab6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:30.251599 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-98d774a0-0e32-4771-a45c-f9146e7acab6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:30.259126 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98d774a0-0e32-4771-a45c-f9146e7acab6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:30.259613 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98d774a0-0e32-4771-a45c-f9146e7acab6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:30.260057 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98d774a0-0e32-4771-a45c-f9146e7acab6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:30.260771 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98d774a0-0e32-4771-a45c-f9146e7acab6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:30.261396 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98d774a0-0e32-4771-a45c-f9146e7acab6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:30.261829 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98d774a0-0e32-4771-a45c-f9146e7acab6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:30.395936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-98d774a0-0e32-4771-a45c-f9146e7acab6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:30.404296 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-98d774a0-0e32-4771-a45c-f9146e7acab6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1710 microversion: 2.1 time: 0.157208 Sep 26 05:33:30.404955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 277/575] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:30 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1710 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:30.495614 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-495ea0b8-5aec-4560-98fe-e37c5a467c0c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:30.496505 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-495ea0b8-5aec-4560-98fe-e37c5a467c0c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:30.503171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-495ea0b8-5aec-4560-98fe-e37c5a467c0c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:30.503620 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-495ea0b8-5aec-4560-98fe-e37c5a467c0c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:30.504243 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-495ea0b8-5aec-4560-98fe-e37c5a467c0c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:30.505563 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-495ea0b8-5aec-4560-98fe-e37c5a467c0c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:30.505672 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-495ea0b8-5aec-4560-98fe-e37c5a467c0c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:30.506012 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-495ea0b8-5aec-4560-98fe-e37c5a467c0c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:30.637823 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-495ea0b8-5aec-4560-98fe-e37c5a467c0c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:30.646052 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-495ea0b8-5aec-4560-98fe-e37c5a467c0c tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1513 microversion: 2.1 time: 0.156202 Sep 26 05:33:30.647144 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 299/576] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:30 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:31.061410 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-08d1e95c-0e2d-4a51-b66b-4b39636b992a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-88047459", "imageRef": "d37a4f3d-6311-48af-9e33-4c62c14cdd1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "542c3891-aa7c-4297-a50e-fe5b71cd3cf3"}], "security_groups": [{"name": "tempest-securitygroup--1771268680"}], "key_name": "tempest-keypair-1549388733", "user_data": "}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:33:31.165416 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-08d1e95c-0e2d-4a51-b66b-4b39636b992a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] validate_networks() for [('542c3891-aa7c-4297-a50e-fe5b71cd3cf3', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:33:31.427494 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5898c3f3-3e4e-47d5-a94d-660da724962f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:31.428034 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5898c3f3-3e4e-47d5-a94d-660da724962f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:31.434011 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5898c3f3-3e4e-47d5-a94d-660da724962f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:31.434493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5898c3f3-3e4e-47d5-a94d-660da724962f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:31.435361 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5898c3f3-3e4e-47d5-a94d-660da724962f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:31.435608 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5898c3f3-3e4e-47d5-a94d-660da724962f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:31.436066 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5898c3f3-3e4e-47d5-a94d-660da724962f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:31.436512 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5898c3f3-3e4e-47d5-a94d-660da724962f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:31.587185 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-08d1e95c-0e2d-4a51-b66b-4b39636b992a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:33:31.587688 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-08d1e95c-0e2d-4a51-b66b-4b39636b992a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:33:31.588156 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-08d1e95c-0e2d-4a51-b66b-4b39636b992a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:33:31.588611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-08d1e95c-0e2d-4a51-b66b-4b39636b992a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:33:31.589049 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-08d1e95c-0e2d-4a51-b66b-4b39636b992a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:33:31.598168 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-08d1e95c-0e2d-4a51-b66b-4b39636b992a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:31.598644 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-08d1e95c-0e2d-4a51-b66b-4b39636b992a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:31.599093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-08d1e95c-0e2d-4a51-b66b-4b39636b992a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:31.600003 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-08d1e95c-0e2d-4a51-b66b-4b39636b992a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:31.600496 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-08d1e95c-0e2d-4a51-b66b-4b39636b992a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:31.600920 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-08d1e95c-0e2d-4a51-b66b-4b39636b992a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:31.618204 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-08d1e95c-0e2d-4a51-b66b-4b39636b992a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Getting quotas for project fd13dd8ec810435491e3f3cba7cca4d1. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:33:31.622122 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-08d1e95c-0e2d-4a51-b66b-4b39636b992a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Getting quotas for user 48e588ff6d5a4a37b902abadfb6d04fc and project fd13dd8ec810435491e3f3cba7cca4d1. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:33:31.633486 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-08d1e95c-0e2d-4a51-b66b-4b39636b992a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:33:31.635778 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-08d1e95c-0e2d-4a51-b66b-4b39636b992a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d37a4f3d-6311-48af-9e33-4c62c14cdd1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:33:31.657118 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5898c3f3-3e4e-47d5-a94d-660da724962f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:31.666290 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5898c3f3-3e4e-47d5-a94d-660da724962f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1710 microversion: 2.1 time: 0.242827 Sep 26 05:33:31.667045 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 300/577] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:31 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1710 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:33:31.686204 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-08d1e95c-0e2d-4a51-b66b-4b39636b992a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.629000 Sep 26 05:33:31.686960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 278/578] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:33:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:33:31.688222 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a4d01b9d-4771-40d4-a26c-4c962a7ba386 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:31.689013 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a4d01b9d-4771-40d4-a26c-4c962a7ba386 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:31.696028 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4d01b9d-4771-40d4-a26c-4c962a7ba386 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:31.696869 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4d01b9d-4771-40d4-a26c-4c962a7ba386 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:31.697544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4d01b9d-4771-40d4-a26c-4c962a7ba386 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:31.698450 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4d01b9d-4771-40d4-a26c-4c962a7ba386 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:31.699030 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d05f07da-9cf3-4893-9039-c3082fc2b99b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:31.699371 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4d01b9d-4771-40d4-a26c-4c962a7ba386 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:31.699646 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d05f07da-9cf3-4893-9039-c3082fc2b99b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:31.700263 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4d01b9d-4771-40d4-a26c-4c962a7ba386 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:31.735303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:31.766578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d05f07da-9cf3-4893-9039-c3082fc2b99b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:31.778065 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d05f07da-9cf3-4893-9039-c3082fc2b99b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 200 len: 1240 microversion: 2.1 time: 0.082784 Sep 26 05:33:31.783560 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 279/579] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:31 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:33:31.904235 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a4d01b9d-4771-40d4-a26c-4c962a7ba386 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:31.913839 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a4d01b9d-4771-40d4-a26c-4c962a7ba386 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1513 microversion: 2.1 time: 0.232519 Sep 26 05:33:31.914348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 301/580] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:31 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:32.695663 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c0703b3b-81f3-480d-96c6-4a0b80545bfb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:32.696321 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c0703b3b-81f3-480d-96c6-4a0b80545bfb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:32.702962 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c0703b3b-81f3-480d-96c6-4a0b80545bfb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:32.703440 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c0703b3b-81f3-480d-96c6-4a0b80545bfb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:32.703872 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c0703b3b-81f3-480d-96c6-4a0b80545bfb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:32.704582 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c0703b3b-81f3-480d-96c6-4a0b80545bfb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:32.705029 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c0703b3b-81f3-480d-96c6-4a0b80545bfb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:32.705443 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c0703b3b-81f3-480d-96c6-4a0b80545bfb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:32.809012 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-820e7615-40af-4428-b182-76c65b90f5bc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:32.809633 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-820e7615-40af-4428-b182-76c65b90f5bc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:32.816006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-820e7615-40af-4428-b182-76c65b90f5bc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:32.816549 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-820e7615-40af-4428-b182-76c65b90f5bc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:32.816981 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-820e7615-40af-4428-b182-76c65b90f5bc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:32.817856 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-820e7615-40af-4428-b182-76c65b90f5bc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:32.818927 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-820e7615-40af-4428-b182-76c65b90f5bc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:32.819527 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-820e7615-40af-4428-b182-76c65b90f5bc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:32.919522 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-820e7615-40af-4428-b182-76c65b90f5bc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:32.925532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c0703b3b-81f3-480d-96c6-4a0b80545bfb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:32.931191 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-820e7615-40af-4428-b182-76c65b90f5bc tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 200 len: 1236 microversion: 2.1 time: 0.133301 Sep 26 05:33:32.933948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 302/581] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:32 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 1236 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:32.934684 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c0703b3b-81f3-480d-96c6-4a0b80545bfb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1710 microversion: 2.1 time: 0.243333 Sep 26 05:33:32.935442 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 280/582] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:32 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1710 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:32.949918 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-02562206-8e10-4e9d-ba8b-a2842bcf4f14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:32.950658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-02562206-8e10-4e9d-ba8b-a2842bcf4f14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:32.956699 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-02562206-8e10-4e9d-ba8b-a2842bcf4f14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:32.957262 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-02562206-8e10-4e9d-ba8b-a2842bcf4f14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:32.957777 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-02562206-8e10-4e9d-ba8b-a2842bcf4f14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:32.958570 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-02562206-8e10-4e9d-ba8b-a2842bcf4f14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:32.959561 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-02562206-8e10-4e9d-ba8b-a2842bcf4f14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:32.959994 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-02562206-8e10-4e9d-ba8b-a2842bcf4f14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:33.175296 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-02562206-8e10-4e9d-ba8b-a2842bcf4f14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:33.183215 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-02562206-8e10-4e9d-ba8b-a2842bcf4f14 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1513 microversion: 2.1 time: 0.237176 Sep 26 05:33:33.183793 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 303/583] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:32 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:33:33.390455 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-8cefc10e-9c96-49d0-bccc-d0f50ea12597 req-231da738-fccf-48fe-b296-9b98fd11f7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47570062-ca33-436f-ab80-34918ac9c78e", "name": "network-vif-deleted", "tag": "f45daf39-254f-46e8-9700-adeb9299ab9b"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:33:33.400595 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-8cefc10e-9c96-49d0-bccc-d0f50ea12597 req-231da738-fccf-48fe-b296-9b98fd11f7a4 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:33.401062 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-8cefc10e-9c96-49d0-bccc-d0f50ea12597 req-231da738-fccf-48fe-b296-9b98fd11f7a4 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:33.401486 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-8cefc10e-9c96-49d0-bccc-d0f50ea12597 req-231da738-fccf-48fe-b296-9b98fd11f7a4 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:33.413236 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-8cefc10e-9c96-49d0-bccc-d0f50ea12597 req-231da738-fccf-48fe-b296-9b98fd11f7a4 service nova] Creating event network-vif-deleted:f45daf39-254f-46e8-9700-adeb9299ab9b for instance 47570062-ca33-436f-ab80-34918ac9c78e on hv-cinder-85918 Sep 26 05:33:33.418143 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-8cefc10e-9c96-49d0-bccc-d0f50ea12597 req-231da738-fccf-48fe-b296-9b98fd11f7a4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031343 Sep 26 05:33:33.418712 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 281/584] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:33:33.957090 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6cfd1afc-1f7a-4ecb-8431-c0b6d5940921 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:33.957705 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6cfd1afc-1f7a-4ecb-8431-c0b6d5940921 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:33.958980 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-37394714-b0f9-46ec-bb61-5df1dacb083e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:33.959745 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-37394714-b0f9-46ec-bb61-5df1dacb083e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:33.964740 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6cfd1afc-1f7a-4ecb-8431-c0b6d5940921 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:33.965216 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6cfd1afc-1f7a-4ecb-8431-c0b6d5940921 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:33.965645 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6cfd1afc-1f7a-4ecb-8431-c0b6d5940921 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:33.965821 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-37394714-b0f9-46ec-bb61-5df1dacb083e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:33.966299 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-37394714-b0f9-46ec-bb61-5df1dacb083e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:33.966418 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6cfd1afc-1f7a-4ecb-8431-c0b6d5940921 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:33.966731 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-37394714-b0f9-46ec-bb61-5df1dacb083e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:33.966837 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6cfd1afc-1f7a-4ecb-8431-c0b6d5940921 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:33.967162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6cfd1afc-1f7a-4ecb-8431-c0b6d5940921 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:33.967415 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-37394714-b0f9-46ec-bb61-5df1dacb083e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:33.967866 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-37394714-b0f9-46ec-bb61-5df1dacb083e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:33.968313 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-37394714-b0f9-46ec-bb61-5df1dacb083e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:34.298369 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6cfd1afc-1f7a-4ecb-8431-c0b6d5940921 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:34.306563 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6cfd1afc-1f7a-4ecb-8431-c0b6d5940921 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 200 len: 1292 microversion: 2.1 time: 0.353438 Sep 26 05:33:34.320724 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 304/585] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:33 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 1292 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:34.325895 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6b0a2c44-5031-4a01-b633-a4e388c6b4d4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:34.326629 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6b0a2c44-5031-4a01-b633-a4e388c6b4d4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:34.328711 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:34.334427 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b0a2c44-5031-4a01-b633-a4e388c6b4d4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:34.334951 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b0a2c44-5031-4a01-b633-a4e388c6b4d4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:34.335392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b0a2c44-5031-4a01-b633-a4e388c6b4d4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:34.336129 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b0a2c44-5031-4a01-b633-a4e388c6b4d4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:34.336622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b0a2c44-5031-4a01-b633-a4e388c6b4d4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:34.337050 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b0a2c44-5031-4a01-b633-a4e388c6b4d4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:34.369704 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-37394714-b0f9-46ec-bb61-5df1dacb083e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:34.377416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b0a2c44-5031-4a01-b633-a4e388c6b4d4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:34.377901 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b0a2c44-5031-4a01-b633-a4e388c6b4d4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:34.378341 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b0a2c44-5031-4a01-b633-a4e388c6b4d4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:34.378787 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-6b0a2c44-5031-4a01-b633-a4e388c6b4d4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lazy-loading 'fault' on Instance uuid 47570062-ca33-436f-ab80-34918ac9c78e {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:33:34.379322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-37394714-b0f9-46ec-bb61-5df1dacb083e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1714 microversion: 2.1 time: 0.425651 Sep 26 05:33:34.379894 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 282/586] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:33 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1714 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:33:34.428260 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6b0a2c44-5031-4a01-b633-a4e388c6b4d4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:34.435739 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6b0a2c44-5031-4a01-b633-a4e388c6b4d4 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1309 microversion: 2.1 time: 0.113756 Sep 26 05:33:34.436308 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 305/587] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:34 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:35.329720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2b84f778-81ac-41ba-b2e0-e4ef15083e9d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:35.330323 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2b84f778-81ac-41ba-b2e0-e4ef15083e9d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:35.337216 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b84f778-81ac-41ba-b2e0-e4ef15083e9d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:35.337691 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b84f778-81ac-41ba-b2e0-e4ef15083e9d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:35.338121 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b84f778-81ac-41ba-b2e0-e4ef15083e9d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:35.338805 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b84f778-81ac-41ba-b2e0-e4ef15083e9d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:35.339247 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b84f778-81ac-41ba-b2e0-e4ef15083e9d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:35.339689 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b84f778-81ac-41ba-b2e0-e4ef15083e9d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:35.409465 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2b84f778-81ac-41ba-b2e0-e4ef15083e9d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:35.418151 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2b84f778-81ac-41ba-b2e0-e4ef15083e9d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 200 len: 1298 microversion: 2.1 time: 0.092202 Sep 26 05:33:35.418722 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 283/588] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:35 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:35.459642 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a6b90c89-da5a-4db6-a06e-72018563b94a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:35.460392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a6b90c89-da5a-4db6-a06e-72018563b94a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:35.466378 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6b90c89-da5a-4db6-a06e-72018563b94a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:35.466873 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6b90c89-da5a-4db6-a06e-72018563b94a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:35.467308 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6b90c89-da5a-4db6-a06e-72018563b94a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:35.468007 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6b90c89-da5a-4db6-a06e-72018563b94a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:35.468495 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6b90c89-da5a-4db6-a06e-72018563b94a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:35.468920 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6b90c89-da5a-4db6-a06e-72018563b94a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:35.501106 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6b90c89-da5a-4db6-a06e-72018563b94a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:35.501504 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6b90c89-da5a-4db6-a06e-72018563b94a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:35.501941 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6b90c89-da5a-4db6-a06e-72018563b94a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:35.502386 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-a6b90c89-da5a-4db6-a06e-72018563b94a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lazy-loading 'fault' on Instance uuid 47570062-ca33-436f-ab80-34918ac9c78e {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:33:35.553402 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a6b90c89-da5a-4db6-a06e-72018563b94a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e391d2591734de3bbe2515c703c4602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241e5470186a4c93b2465ecc84d80603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:35.561102 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a6b90c89-da5a-4db6-a06e-72018563b94a tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 200 len: 1309 microversion: 2.1 time: 0.106024 Sep 26 05:33:35.561654 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 306/589] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:35 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:36.441684 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b604fc7a-fe54-4994-815d-a876d6eb9467 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:36.442379 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b604fc7a-fe54-4994-815d-a876d6eb9467 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:36.448669 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b604fc7a-fe54-4994-815d-a876d6eb9467 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:36.449151 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b604fc7a-fe54-4994-815d-a876d6eb9467 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:36.449582 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b604fc7a-fe54-4994-815d-a876d6eb9467 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:36.450263 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b604fc7a-fe54-4994-815d-a876d6eb9467 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:36.450885 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b604fc7a-fe54-4994-815d-a876d6eb9467 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:36.451304 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b604fc7a-fe54-4994-815d-a876d6eb9467 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:36.584642 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-51a7fd07-2f2e-4333-977f-f5d50086daa7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:36.585260 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-51a7fd07-2f2e-4333-977f-f5d50086daa7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] [instance: 47570062-ca33-436f-ab80-34918ac9c78e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:36.591617 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-51a7fd07-2f2e-4333-977f-f5d50086daa7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:36.592103 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-51a7fd07-2f2e-4333-977f-f5d50086daa7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:36.592572 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-51a7fd07-2f2e-4333-977f-f5d50086daa7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:36.593272 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-51a7fd07-2f2e-4333-977f-f5d50086daa7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:36.593727 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-51a7fd07-2f2e-4333-977f-f5d50086daa7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:36.594155 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-51a7fd07-2f2e-4333-977f-f5d50086daa7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:36.609503 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-51a7fd07-2f2e-4333-977f-f5d50086daa7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] HTTP exception thrown: Instance 47570062-ca33-436f-ab80-34918ac9c78e could not be found. Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-51a7fd07-2f2e-4333-977f-f5d50086daa7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Request method failure captured: Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e HTTP/1.1 Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTkIWz4r7VyOkqI7evq1PQUupA0KYhTobIR5Ht4Dmu6jASBBHWBhBYykfwxR2Ujc4uFsHR8n9hm66a9Sa2-PGj-ckmb61JR1DQeP5IkDOuBXFpwctTbYefNTjfBdKepsnk8VZQ3F8a1wMorz_FDHnq8mu9uwPNPM46pcBAjNVaaWku0 Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: 241e5470186a4c93b2465ecc84d80603 Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-VolumesSnapshotTestJSON-688590265 Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:33:36.611174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:33:36.612488 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/241e5470186a4c93b2465ecc84d80603"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/241e5470186a4c93b2465ecc84d80603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/241e5470186a4c93b2465ecc84d80603"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_241e5470186a4c93b2465ecc84d80603"}]}] Sep 26 05:33:36.612488 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-VolumesSnapshotTestJSON-688590265 Sep 26 05:33:36.612488 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: 241e5470186a4c93b2465ecc84d80603 Sep 26 05:33:36.612488 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-688590265 Sep 26 05:33:36.612488 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-VolumesSnapshotTestJSON-688590265-project Sep 26 05:33:36.612488 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:33:36.612488 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:33:36.612488 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 1e391d2591734de3bbe2515c703c4602 Sep 26 05:33:36.612488 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-VolumesSnapshotTestJSON-688590265-project Sep 26 05:33:36.612488 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:33:36.612488 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance 47570062-ca33-436f-ab80-34918ac9c78e could not be found. Sep 26 05:33:36.612488 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': '47570062-ca33-436f-ab80-34918ac9c78e'} Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47570062-ca33-436f-ab80-34918ac9c78e could not be found. Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:33:36.613232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:33:36.614408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:33:36.614408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:33:36.614408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:33:36.614408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:33:36.614408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:33:36.614408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:33:36.614408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:33:36.614408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47570062-ca33-436f-ab80-34918ac9c78e could not be found. Sep 26 05:33:36.614408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:33:36.614408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:33:36.614408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:33:36.614408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:33:36.614408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:33:36.614408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:33:36.614408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:33:36.614408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:33:36.614408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47570062-ca33-436f-ab80-34918ac9c78e could not be found. Sep 26 05:33:36.614408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:33:36.616440 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-51a7fd07-2f2e-4333-977f-f5d50086daa7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] Returning 404 to user: Instance 47570062-ca33-436f-ab80-34918ac9c78e could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:33:36.616440 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-51a7fd07-2f2e-4333-977f-f5d50086daa7 tempest-VolumesSnapshotTestJSON-688590265 tempest-VolumesSnapshotTestJSON-688590265-project] 10.222.0.49 "GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e" status: 404 len: 111 microversion: 2.1 time: 0.032158 Sep 26 05:33:36.616440 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 307/590] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:36 2022] GET /compute/v2.1/servers/47570062-ca33-436f-ab80-34918ac9c78e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:33:36.650196 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b604fc7a-fe54-4994-815d-a876d6eb9467 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:36.659330 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b604fc7a-fe54-4994-815d-a876d6eb9467 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 200 len: 1366 microversion: 2.1 time: 0.221574 Sep 26 05:33:36.659923 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 284/591] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:36 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:36.707677 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-e82789af-5824-4d7a-8833-6012e925381c req-15930573-482e-4206-841d-8f5706cbfede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43405413-d653-4c48-acc8-3af217fb7ea2", "tag": "a1082fba-8ef8-438a-a567-b6ff8339736c"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:33:36.721682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-e82789af-5824-4d7a-8833-6012e925381c req-15930573-482e-4206-841d-8f5706cbfede service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:36.722328 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-e82789af-5824-4d7a-8833-6012e925381c req-15930573-482e-4206-841d-8f5706cbfede service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:36.722866 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-e82789af-5824-4d7a-8833-6012e925381c req-15930573-482e-4206-841d-8f5706cbfede service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:36.737487 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-e82789af-5824-4d7a-8833-6012e925381c req-15930573-482e-4206-841d-8f5706cbfede service nova] Creating event network-changed:a1082fba-8ef8-438a-a567-b6ff8339736c for instance 43405413-d653-4c48-acc8-3af217fb7ea2 on hv-cinder-85918 Sep 26 05:33:36.744066 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-e82789af-5824-4d7a-8833-6012e925381c req-15930573-482e-4206-841d-8f5706cbfede service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042029 Sep 26 05:33:36.744892 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 308/592] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:33:37.683410 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e441d92b-c669-42ec-98e7-b2310587730e tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:37.684024 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e441d92b-c669-42ec-98e7-b2310587730e tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:37.686458 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:37.692092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e441d92b-c669-42ec-98e7-b2310587730e tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:37.693294 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e441d92b-c669-42ec-98e7-b2310587730e tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:37.693879 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e441d92b-c669-42ec-98e7-b2310587730e tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:37.694572 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e441d92b-c669-42ec-98e7-b2310587730e tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:37.695026 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e441d92b-c669-42ec-98e7-b2310587730e tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:37.695456 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e441d92b-c669-42ec-98e7-b2310587730e tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:37.825508 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e441d92b-c669-42ec-98e7-b2310587730e tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:37.833041 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e441d92b-c669-42ec-98e7-b2310587730e tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 200 len: 1366 microversion: 2.1 time: 0.153607 Sep 26 05:33:37.833603 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 285/593] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:37 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:38.858007 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-94ead139-0221-4c8f-843f-3e5717448550 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:38.858706 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-94ead139-0221-4c8f-843f-3e5717448550 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:38.864780 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-94ead139-0221-4c8f-843f-3e5717448550 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:38.865258 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-94ead139-0221-4c8f-843f-3e5717448550 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:38.865714 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-94ead139-0221-4c8f-843f-3e5717448550 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:38.866398 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-94ead139-0221-4c8f-843f-3e5717448550 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:38.866846 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-94ead139-0221-4c8f-843f-3e5717448550 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:38.867273 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-94ead139-0221-4c8f-843f-3e5717448550 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:38.993013 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-94ead139-0221-4c8f-843f-3e5717448550 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:39.000729 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-94ead139-0221-4c8f-843f-3e5717448550 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 200 len: 1366 microversion: 2.1 time: 0.147718 Sep 26 05:33:39.001286 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 309/594] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:38 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:39.672781 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-dcdb33ff-c09c-492d-84b4-c9ae87fe3059 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b54d688-fb3b-40b0-b495-613a548f923d"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:33:39.675137 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-dcdb33ff-c09c-492d-84b4-c9ae87fe3059 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:39.682525 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcdb33ff-c09c-492d-84b4-c9ae87fe3059 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:39.683003 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcdb33ff-c09c-492d-84b4-c9ae87fe3059 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:39.683440 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcdb33ff-c09c-492d-84b4-c9ae87fe3059 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:39.684118 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcdb33ff-c09c-492d-84b4-c9ae87fe3059 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:39.684595 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcdb33ff-c09c-492d-84b4-c9ae87fe3059 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:39.685018 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcdb33ff-c09c-492d-84b4-c9ae87fe3059 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:39.698664 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:40.024820 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-648a1876-27ba-471e-a613-1d83681270ec tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:40.025433 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-648a1876-27ba-471e-a613-1d83681270ec tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:40.027416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=4 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:40.033575 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-648a1876-27ba-471e-a613-1d83681270ec tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:40.034060 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-648a1876-27ba-471e-a613-1d83681270ec tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:40.034499 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-648a1876-27ba-471e-a613-1d83681270ec tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:40.035241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-648a1876-27ba-471e-a613-1d83681270ec tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:40.035695 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-648a1876-27ba-471e-a613-1d83681270ec tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:40.036119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-648a1876-27ba-471e-a613-1d83681270ec tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:40.166460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-648a1876-27ba-471e-a613-1d83681270ec tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:40.174085 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-648a1876-27ba-471e-a613-1d83681270ec tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 200 len: 1366 microversion: 2.1 time: 0.153667 Sep 26 05:33:40.174672 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 310/595] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:40 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:33:41.196922 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b28bb08c-2629-4cc7-b9a8-adbd3b4af580 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:41.197518 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b28bb08c-2629-4cc7-b9a8-adbd3b4af580 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:41.203882 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b28bb08c-2629-4cc7-b9a8-adbd3b4af580 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:41.204402 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b28bb08c-2629-4cc7-b9a8-adbd3b4af580 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:41.204837 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b28bb08c-2629-4cc7-b9a8-adbd3b4af580 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:41.205523 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b28bb08c-2629-4cc7-b9a8-adbd3b4af580 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:41.205974 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b28bb08c-2629-4cc7-b9a8-adbd3b4af580 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:41.206399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b28bb08c-2629-4cc7-b9a8-adbd3b4af580 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:41.330190 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b28bb08c-2629-4cc7-b9a8-adbd3b4af580 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:41.338395 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b28bb08c-2629-4cc7-b9a8-adbd3b4af580 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 200 len: 1366 microversion: 2.1 time: 0.145479 Sep 26 05:33:41.338994 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 311/596] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:41 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:33:41.609235 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:41.776284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=8 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:41.953593 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-dcdb33ff-c09c-492d-84b4-c9ae87fe3059 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "POST /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.284612 Sep 26 05:33:41.954249 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 286/597] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 05:33:39 2022] POST /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/os-volume_attachments => generated 194 bytes in 2286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:33:42.361459 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-592dc618-9f1a-4e1e-8cf9-3220ca67469b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:42.361988 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-592dc618-9f1a-4e1e-8cf9-3220ca67469b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:42.369357 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-592dc618-9f1a-4e1e-8cf9-3220ca67469b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:42.369845 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-592dc618-9f1a-4e1e-8cf9-3220ca67469b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:42.370285 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-592dc618-9f1a-4e1e-8cf9-3220ca67469b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:42.370984 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-592dc618-9f1a-4e1e-8cf9-3220ca67469b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:42.371439 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-592dc618-9f1a-4e1e-8cf9-3220ca67469b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:42.371863 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-592dc618-9f1a-4e1e-8cf9-3220ca67469b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:42.509761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-592dc618-9f1a-4e1e-8cf9-3220ca67469b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:42.517469 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-592dc618-9f1a-4e1e-8cf9-3220ca67469b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 200 len: 1366 microversion: 2.1 time: 0.160059 Sep 26 05:33:42.518242 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 312/598] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:42 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:43.543786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1d974eab-95c4-47a1-82ae-36c9910d4268 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:43.544496 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1d974eab-95c4-47a1-82ae-36c9910d4268 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:43.550662 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1d974eab-95c4-47a1-82ae-36c9910d4268 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:43.551148 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1d974eab-95c4-47a1-82ae-36c9910d4268 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:43.551585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1d974eab-95c4-47a1-82ae-36c9910d4268 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:43.552286 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1d974eab-95c4-47a1-82ae-36c9910d4268 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:43.552742 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1d974eab-95c4-47a1-82ae-36c9910d4268 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:43.553199 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1d974eab-95c4-47a1-82ae-36c9910d4268 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:43.684826 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1d974eab-95c4-47a1-82ae-36c9910d4268 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:43.692519 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1d974eab-95c4-47a1-82ae-36c9910d4268 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 200 len: 1366 microversion: 2.1 time: 0.153429 Sep 26 05:33:43.693098 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 287/599] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:43 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:43.761712 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-fad1b3ef-bd94-4532-a361-559af90aab72 req-02216ed6-d8de-4206-b3b4-b91dc5f2513d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43405413-d653-4c48-acc8-3af217fb7ea2", "name": "network-vif-plugged", "status": "completed", "tag": "a1082fba-8ef8-438a-a567-b6ff8339736c"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:33:43.773126 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-fad1b3ef-bd94-4532-a361-559af90aab72 req-02216ed6-d8de-4206-b3b4-b91dc5f2513d service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:43.773598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-fad1b3ef-bd94-4532-a361-559af90aab72 req-02216ed6-d8de-4206-b3b4-b91dc5f2513d service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:43.774120 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-fad1b3ef-bd94-4532-a361-559af90aab72 req-02216ed6-d8de-4206-b3b4-b91dc5f2513d service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:43.785247 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-fad1b3ef-bd94-4532-a361-559af90aab72 req-02216ed6-d8de-4206-b3b4-b91dc5f2513d service nova] Creating event network-vif-plugged:a1082fba-8ef8-438a-a567-b6ff8339736c for instance 43405413-d653-4c48-acc8-3af217fb7ea2 on hv-cinder-85918 Sep 26 05:33:43.802602 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-fad1b3ef-bd94-4532-a361-559af90aab72 req-02216ed6-d8de-4206-b3b4-b91dc5f2513d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045052 Sep 26 05:33:43.803824 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 313/600] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:33:44.715527 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d96ff47c-5f3b-4e96-968d-ab648ab4f630 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:44.716172 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d96ff47c-5f3b-4e96-968d-ab648ab4f630 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:44.722531 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d96ff47c-5f3b-4e96-968d-ab648ab4f630 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:44.723010 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d96ff47c-5f3b-4e96-968d-ab648ab4f630 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:44.723443 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d96ff47c-5f3b-4e96-968d-ab648ab4f630 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:44.724157 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d96ff47c-5f3b-4e96-968d-ab648ab4f630 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:44.724631 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d96ff47c-5f3b-4e96-968d-ab648ab4f630 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:44.725065 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d96ff47c-5f3b-4e96-968d-ab648ab4f630 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:44.857173 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d96ff47c-5f3b-4e96-968d-ab648ab4f630 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:44.864760 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d96ff47c-5f3b-4e96-968d-ab648ab4f630 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 200 len: 1366 microversion: 2.1 time: 0.153078 Sep 26 05:33:44.865360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 288/601] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:44 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:45.888453 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c8171980-e931-4619-8a3b-577977572ada tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:45.889148 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c8171980-e931-4619-8a3b-577977572ada tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:45.895249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c8171980-e931-4619-8a3b-577977572ada tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:45.895726 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c8171980-e931-4619-8a3b-577977572ada tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:45.896157 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c8171980-e931-4619-8a3b-577977572ada tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:45.897494 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c8171980-e931-4619-8a3b-577977572ada tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:45.898130 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c8171980-e931-4619-8a3b-577977572ada tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:45.898551 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c8171980-e931-4619-8a3b-577977572ada tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:46.027108 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-c8171980-e931-4619-8a3b-577977572ada tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:46.034983 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c8171980-e931-4619-8a3b-577977572ada tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 200 len: 1557 microversion: 2.1 time: 0.151395 Sep 26 05:33:46.035536 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 314/602] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:45 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:46.057593 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3463d962-0e5f-472b-b93a-baaf97b833e7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:46.058095 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3463d962-0e5f-472b-b93a-baaf97b833e7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:46.064366 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3463d962-0e5f-472b-b93a-baaf97b833e7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:46.064841 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3463d962-0e5f-472b-b93a-baaf97b833e7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:46.065270 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3463d962-0e5f-472b-b93a-baaf97b833e7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:46.065942 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3463d962-0e5f-472b-b93a-baaf97b833e7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:46.066383 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3463d962-0e5f-472b-b93a-baaf97b833e7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:46.066796 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3463d962-0e5f-472b-b93a-baaf97b833e7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:46.142901 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3463d962-0e5f-472b-b93a-baaf97b833e7 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089156 Sep 26 05:33:46.143490 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 289/603] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 05:33:46 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:33:47.062216 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-08102467-f6be-450c-84e6-7959e7263f2f req-92f09ab1-b7eb-4331-b2b1-89cb61ae2806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43405413-d653-4c48-acc8-3af217fb7ea2", "tag": "a1082fba-8ef8-438a-a567-b6ff8339736c"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:33:47.072533 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-08102467-f6be-450c-84e6-7959e7263f2f req-92f09ab1-b7eb-4331-b2b1-89cb61ae2806 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:47.073017 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-08102467-f6be-450c-84e6-7959e7263f2f req-92f09ab1-b7eb-4331-b2b1-89cb61ae2806 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:47.073448 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-08102467-f6be-450c-84e6-7959e7263f2f req-92f09ab1-b7eb-4331-b2b1-89cb61ae2806 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:47.085709 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-08102467-f6be-450c-84e6-7959e7263f2f req-92f09ab1-b7eb-4331-b2b1-89cb61ae2806 service nova] Creating event network-changed:a1082fba-8ef8-438a-a567-b6ff8339736c for instance 43405413-d653-4c48-acc8-3af217fb7ea2 on hv-cinder-85918 Sep 26 05:33:47.090725 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-08102467-f6be-450c-84e6-7959e7263f2f req-92f09ab1-b7eb-4331-b2b1-89cb61ae2806 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032067 Sep 26 05:33:47.091327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 315/604] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:33:51.628764 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-97bdc069-2985-46be-b99b-510676310a9e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:33:51.632024 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-97bdc069-2985-46be-b99b-510676310a9e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:51.638006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-97bdc069-2985-46be-b99b-510676310a9e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:51.638487 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-97bdc069-2985-46be-b99b-510676310a9e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:51.638922 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-97bdc069-2985-46be-b99b-510676310a9e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:51.639608 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-97bdc069-2985-46be-b99b-510676310a9e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:51.640060 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-97bdc069-2985-46be-b99b-510676310a9e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:51.640507 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-97bdc069-2985-46be-b99b-510676310a9e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:51.664403 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-97bdc069-2985-46be-b99b-510676310a9e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lazy-loading 'flavor' on Instance uuid 30c51093-517b-4a33-9d80-8bf0e1747e75 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:33:51.785493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-97bdc069-2985-46be-b99b-510676310a9e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "POST /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/action" status: 200 len: 32 microversion: 2.1 time: 0.161225 Sep 26 05:33:51.786024 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 290/605] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 05:33:51 2022] POST /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:33:51.796916 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a8b8742d-3a85-4a9a-badf-1e5ff051b724 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:51.797704 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a8b8742d-3a85-4a9a-badf-1e5ff051b724 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:51.804407 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a8b8742d-3a85-4a9a-badf-1e5ff051b724 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:51.804889 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a8b8742d-3a85-4a9a-badf-1e5ff051b724 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:51.805506 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a8b8742d-3a85-4a9a-badf-1e5ff051b724 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:51.806318 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a8b8742d-3a85-4a9a-badf-1e5ff051b724 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:51.806715 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a8b8742d-3a85-4a9a-badf-1e5ff051b724 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:51.807117 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a8b8742d-3a85-4a9a-badf-1e5ff051b724 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:52.020380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a8b8742d-3a85-4a9a-badf-1e5ff051b724 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:52.029305 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a8b8742d-3a85-4a9a-badf-1e5ff051b724 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.237197 Sep 26 05:33:52.029952 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 316/606] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:51 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:53.053927 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2f97128d-dabf-409a-9edc-ea2c8303bbd2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:53.054623 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2f97128d-dabf-409a-9edc-ea2c8303bbd2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:53.060774 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f97128d-dabf-409a-9edc-ea2c8303bbd2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:53.061256 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f97128d-dabf-409a-9edc-ea2c8303bbd2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:53.061688 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f97128d-dabf-409a-9edc-ea2c8303bbd2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:53.062363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f97128d-dabf-409a-9edc-ea2c8303bbd2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:53.062810 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f97128d-dabf-409a-9edc-ea2c8303bbd2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:53.063261 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f97128d-dabf-409a-9edc-ea2c8303bbd2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:53.191596 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2f97128d-dabf-409a-9edc-ea2c8303bbd2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:53.199714 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2f97128d-dabf-409a-9edc-ea2c8303bbd2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.151337 Sep 26 05:33:53.200288 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 291/607] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:53 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:54.223085 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d42c5d01-6f2e-45bb-9bf4-0dcf2a796ba2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:54.223860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d42c5d01-6f2e-45bb-9bf4-0dcf2a796ba2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:54.232125 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d42c5d01-6f2e-45bb-9bf4-0dcf2a796ba2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:54.232639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d42c5d01-6f2e-45bb-9bf4-0dcf2a796ba2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:54.233071 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d42c5d01-6f2e-45bb-9bf4-0dcf2a796ba2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:54.233753 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d42c5d01-6f2e-45bb-9bf4-0dcf2a796ba2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:54.234200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d42c5d01-6f2e-45bb-9bf4-0dcf2a796ba2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:54.234614 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d42c5d01-6f2e-45bb-9bf4-0dcf2a796ba2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:54.363388 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d42c5d01-6f2e-45bb-9bf4-0dcf2a796ba2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:54.371845 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d42c5d01-6f2e-45bb-9bf4-0dcf2a796ba2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.152702 Sep 26 05:33:54.372535 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 317/608] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:54 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:55.395895 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-57f7f21c-3dbc-4501-a080-2959299ac808 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:55.396587 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-57f7f21c-3dbc-4501-a080-2959299ac808 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:55.403171 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-57f7f21c-3dbc-4501-a080-2959299ac808 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:55.403659 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-57f7f21c-3dbc-4501-a080-2959299ac808 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:55.404101 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-57f7f21c-3dbc-4501-a080-2959299ac808 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:55.404817 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-57f7f21c-3dbc-4501-a080-2959299ac808 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:55.405274 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-57f7f21c-3dbc-4501-a080-2959299ac808 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:55.405701 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-57f7f21c-3dbc-4501-a080-2959299ac808 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:55.536019 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-57f7f21c-3dbc-4501-a080-2959299ac808 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:55.545053 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-57f7f21c-3dbc-4501-a080-2959299ac808 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.153111 Sep 26 05:33:55.545617 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 292/609] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:55 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:56.568501 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6b1b3d42-9cbd-46aa-a735-8bdbb07901c3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:56.569100 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6b1b3d42-9cbd-46aa-a735-8bdbb07901c3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:56.576508 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b1b3d42-9cbd-46aa-a735-8bdbb07901c3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:56.576990 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b1b3d42-9cbd-46aa-a735-8bdbb07901c3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:56.577423 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b1b3d42-9cbd-46aa-a735-8bdbb07901c3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:56.578103 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b1b3d42-9cbd-46aa-a735-8bdbb07901c3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:56.578553 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b1b3d42-9cbd-46aa-a735-8bdbb07901c3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:56.578972 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6b1b3d42-9cbd-46aa-a735-8bdbb07901c3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:56.715616 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6b1b3d42-9cbd-46aa-a735-8bdbb07901c3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:56.731693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6b1b3d42-9cbd-46aa-a735-8bdbb07901c3 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.166957 Sep 26 05:33:56.732287 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 318/610] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:56 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:57.756867 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c119138a-7f0f-4d58-b4cd-f0d6537e2e07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:57.757475 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c119138a-7f0f-4d58-b4cd-f0d6537e2e07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:57.764509 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c119138a-7f0f-4d58-b4cd-f0d6537e2e07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:57.764991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c119138a-7f0f-4d58-b4cd-f0d6537e2e07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:57.765428 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c119138a-7f0f-4d58-b4cd-f0d6537e2e07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:57.766108 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c119138a-7f0f-4d58-b4cd-f0d6537e2e07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:57.766562 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c119138a-7f0f-4d58-b4cd-f0d6537e2e07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:57.766987 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c119138a-7f0f-4d58-b4cd-f0d6537e2e07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:57.921018 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c119138a-7f0f-4d58-b4cd-f0d6537e2e07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:57.929354 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c119138a-7f0f-4d58-b4cd-f0d6537e2e07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.176308 Sep 26 05:33:57.929910 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 293/611] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:57 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:33:58.952106 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-275fd2ba-7182-466e-a502-ea1af968c0fa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:33:58.952771 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-275fd2ba-7182-466e-a502-ea1af968c0fa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:33:58.959077 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-275fd2ba-7182-466e-a502-ea1af968c0fa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:58.959537 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-275fd2ba-7182-466e-a502-ea1af968c0fa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:58.959966 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-275fd2ba-7182-466e-a502-ea1af968c0fa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:58.960667 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-275fd2ba-7182-466e-a502-ea1af968c0fa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:33:58.961116 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-275fd2ba-7182-466e-a502-ea1af968c0fa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:33:58.962072 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-275fd2ba-7182-466e-a502-ea1af968c0fa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:33:59.089991 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-275fd2ba-7182-466e-a502-ea1af968c0fa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:33:59.098222 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-275fd2ba-7182-466e-a502-ea1af968c0fa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.149885 Sep 26 05:33:59.098793 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 319/612] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:33:58 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:00.123019 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-21f22ae6-305c-4e17-bd1d-418e4338738b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:00.123635 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-21f22ae6-305c-4e17-bd1d-418e4338738b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:00.130039 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-21f22ae6-305c-4e17-bd1d-418e4338738b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:00.130523 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-21f22ae6-305c-4e17-bd1d-418e4338738b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:00.130963 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-21f22ae6-305c-4e17-bd1d-418e4338738b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:00.131646 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-21f22ae6-305c-4e17-bd1d-418e4338738b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:00.132096 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-21f22ae6-305c-4e17-bd1d-418e4338738b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:00.132550 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-21f22ae6-305c-4e17-bd1d-418e4338738b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:00.264093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-21f22ae6-305c-4e17-bd1d-418e4338738b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:00.272610 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-21f22ae6-305c-4e17-bd1d-418e4338738b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.153421 Sep 26 05:34:00.273191 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 294/613] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:00 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:34:01.297946 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1f6234f8-9850-4027-b434-100367118436 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:01.298591 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-1f6234f8-9850-4027-b434-100367118436 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:01.305380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f6234f8-9850-4027-b434-100367118436 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:01.305904 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f6234f8-9850-4027-b434-100367118436 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:01.306440 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f6234f8-9850-4027-b434-100367118436 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:01.307133 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f6234f8-9850-4027-b434-100367118436 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:01.307589 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f6234f8-9850-4027-b434-100367118436 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:01.308012 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1f6234f8-9850-4027-b434-100367118436 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:01.312148 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=100 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:01.364342 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-28c006fa-8ce5-4fb2-b7ff-99539bb1bef9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:01.365599 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-28c006fa-8ce5-4fb2-b7ff-99539bb1bef9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:01.373792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-28c006fa-8ce5-4fb2-b7ff-99539bb1bef9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:01.374324 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-28c006fa-8ce5-4fb2-b7ff-99539bb1bef9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:01.374765 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-28c006fa-8ce5-4fb2-b7ff-99539bb1bef9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:01.375490 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-28c006fa-8ce5-4fb2-b7ff-99539bb1bef9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:01.376552 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-28c006fa-8ce5-4fb2-b7ff-99539bb1bef9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:01.376996 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-28c006fa-8ce5-4fb2-b7ff-99539bb1bef9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:01.409221 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-28c006fa-8ce5-4fb2-b7ff-99539bb1bef9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/os-volume_attachments/de439b40-a652-4ed0-9b27-d7e1af8759a4" status: 200 len: 194 microversion: 2.20 time: 0.049309 Sep 26 05:34:01.410136 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 295/614] 10.222.0.49 () {60 vars in 1454 bytes} [Mon Sep 26 05:34:01 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/os-volume_attachments/de439b40-a652-4ed0-9b27-d7e1af8759a4 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:34:01.450174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1f6234f8-9850-4027-b434-100367118436 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:01.458929 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1f6234f8-9850-4027-b434-100367118436 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.165694 Sep 26 05:34:01.460317 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 320/615] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:01 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:01.494257 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d46453c4-1a61-4de8-a634-e4777f90b594 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:01.494732 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d46453c4-1a61-4de8-a634-e4777f90b594 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:01.500517 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d46453c4-1a61-4de8-a634-e4777f90b594 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:01.500990 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d46453c4-1a61-4de8-a634-e4777f90b594 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:01.501425 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d46453c4-1a61-4de8-a634-e4777f90b594 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:01.502094 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d46453c4-1a61-4de8-a634-e4777f90b594 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:01.502538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d46453c4-1a61-4de8-a634-e4777f90b594 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:01.502951 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d46453c4-1a61-4de8-a634-e4777f90b594 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:01.585673 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-d46453c4-1a61-4de8-a634-e4777f90b594 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lazy-loading 'services' on Instance uuid 6ffa337e-39e1-4edc-9a0d-4468ff05c577 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:34:01.663314 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d46453c4-1a61-4de8-a634-e4777f90b594 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/os-volume_attachments/de439b40-a652-4ed0-9b27-d7e1af8759a4" status: 202 len: 0 microversion: 2.20 time: 0.172788 Sep 26 05:34:01.663913 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 296/616] 10.222.0.49 () {60 vars in 1457 bytes} [Mon Sep 26 05:34:01 2022] DELETE /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/os-volume_attachments/de439b40-a652-4ed0-9b27-d7e1af8759a4 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:34:01.672206 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-68cd6e9a-877c-4e74-8122-aa561aca2835 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:01.674474 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-68cd6e9a-877c-4e74-8122-aa561aca2835 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:01.680684 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-68cd6e9a-877c-4e74-8122-aa561aca2835 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:01.681433 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-68cd6e9a-877c-4e74-8122-aa561aca2835 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:01.681789 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-68cd6e9a-877c-4e74-8122-aa561aca2835 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:01.682697 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-68cd6e9a-877c-4e74-8122-aa561aca2835 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:01.683167 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-68cd6e9a-877c-4e74-8122-aa561aca2835 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:01.683588 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-68cd6e9a-877c-4e74-8122-aa561aca2835 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:01.718882 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-68cd6e9a-877c-4e74-8122-aa561aca2835 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050507 Sep 26 05:34:01.719579 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 321/617] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Sep 26 05:34:01 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:34:02.487142 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d5584c8d-8d5d-4b2f-b058-aa7f53f29242 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:02.488067 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d5584c8d-8d5d-4b2f-b058-aa7f53f29242 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:02.495265 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5584c8d-8d5d-4b2f-b058-aa7f53f29242 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:02.495765 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5584c8d-8d5d-4b2f-b058-aa7f53f29242 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:02.496220 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5584c8d-8d5d-4b2f-b058-aa7f53f29242 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:02.496935 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5584c8d-8d5d-4b2f-b058-aa7f53f29242 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:02.497389 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5584c8d-8d5d-4b2f-b058-aa7f53f29242 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:02.497812 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5584c8d-8d5d-4b2f-b058-aa7f53f29242 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:02.733562 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-0fd1b116-ce34-4884-941a-b0203ed5da06 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:02.736697 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-0fd1b116-ce34-4884-941a-b0203ed5da06 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:02.750328 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0fd1b116-ce34-4884-941a-b0203ed5da06 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:02.753722 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0fd1b116-ce34-4884-941a-b0203ed5da06 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:02.754267 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0fd1b116-ce34-4884-941a-b0203ed5da06 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:02.755065 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0fd1b116-ce34-4884-941a-b0203ed5da06 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:02.755621 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0fd1b116-ce34-4884-941a-b0203ed5da06 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:02.757365 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0fd1b116-ce34-4884-941a-b0203ed5da06 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:02.822410 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-0fd1b116-ce34-4884-941a-b0203ed5da06 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093406 Sep 26 05:34:02.829920 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 322/618] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Sep 26 05:34:02 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:34:02.848853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d5584c8d-8d5d-4b2f-b058-aa7f53f29242 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:02.859149 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d5584c8d-8d5d-4b2f-b058-aa7f53f29242 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.377774 Sep 26 05:34:02.860399 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 297/619] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:02 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:03.835152 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-daad58de-05be-40d1-a0e4-6f63980d655a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:03.837367 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-daad58de-05be-40d1-a0e4-6f63980d655a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:03.843684 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-daad58de-05be-40d1-a0e4-6f63980d655a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:03.844179 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-daad58de-05be-40d1-a0e4-6f63980d655a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:03.844661 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-daad58de-05be-40d1-a0e4-6f63980d655a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:03.845358 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-daad58de-05be-40d1-a0e4-6f63980d655a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:03.845814 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-daad58de-05be-40d1-a0e4-6f63980d655a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:03.846241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-daad58de-05be-40d1-a0e4-6f63980d655a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:03.876400 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-daad58de-05be-40d1-a0e4-6f63980d655a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045178 Sep 26 05:34:03.882461 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 323/620] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Sep 26 05:34:03 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:03.885920 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d1daf7c8-d0db-4879-8e9c-14f851c298de tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:03.886564 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d1daf7c8-d0db-4879-8e9c-14f851c298de tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:03.893172 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1daf7c8-d0db-4879-8e9c-14f851c298de tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:03.893661 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1daf7c8-d0db-4879-8e9c-14f851c298de tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:03.894299 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1daf7c8-d0db-4879-8e9c-14f851c298de tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:03.895005 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1daf7c8-d0db-4879-8e9c-14f851c298de tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:03.895459 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1daf7c8-d0db-4879-8e9c-14f851c298de tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:03.896058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1daf7c8-d0db-4879-8e9c-14f851c298de tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:03.949995 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-514fd275-4f1a-431d-ac7c-837ac3124643 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:03.950612 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-514fd275-4f1a-431d-ac7c-837ac3124643 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:03.963279 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-514fd275-4f1a-431d-ac7c-837ac3124643 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:03.963811 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-514fd275-4f1a-431d-ac7c-837ac3124643 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:03.964442 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-514fd275-4f1a-431d-ac7c-837ac3124643 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:03.965179 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-514fd275-4f1a-431d-ac7c-837ac3124643 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:03.966086 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-514fd275-4f1a-431d-ac7c-837ac3124643 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:03.966697 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-514fd275-4f1a-431d-ac7c-837ac3124643 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:04.004835 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-514fd275-4f1a-431d-ac7c-837ac3124643 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Going to try to terminate instance {{(pid=120806) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:34:04.143968 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-514fd275-4f1a-431d-ac7c-837ac3124643 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 204 len: 0 microversion: 2.20 time: 0.197648 Sep 26 05:34:04.145010 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 324/621] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Sep 26 05:34:03 2022] DELETE /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 05:34:04.159135 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-617330a7-a383-45d0-9cc9-1d2486426db0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:04.160208 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-617330a7-a383-45d0-9cc9-1d2486426db0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:04.167763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-617330a7-a383-45d0-9cc9-1d2486426db0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:04.168739 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-617330a7-a383-45d0-9cc9-1d2486426db0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:04.169471 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-617330a7-a383-45d0-9cc9-1d2486426db0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:04.170370 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-617330a7-a383-45d0-9cc9-1d2486426db0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:04.170997 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-617330a7-a383-45d0-9cc9-1d2486426db0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:04.171585 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-617330a7-a383-45d0-9cc9-1d2486426db0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:04.504402 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d1daf7c8-d0db-4879-8e9c-14f851c298de tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:04.510217 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-617330a7-a383-45d0-9cc9-1d2486426db0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:04.516655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d1daf7c8-d0db-4879-8e9c-14f851c298de tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.637553 Sep 26 05:34:04.521880 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-617330a7-a383-45d0-9cc9-1d2486426db0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:04.521880 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-617330a7-a383-45d0-9cc9-1d2486426db0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:04.521880 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-617330a7-a383-45d0-9cc9-1d2486426db0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.370469 Sep 26 05:34:04.522207 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 325/622] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:04 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:34:04.522652 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 298/623] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:03 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:34:05.542784 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a4d1dff7-3110-417b-a3a3-33090f05889d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:05.544041 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a4d1dff7-3110-417b-a3a3-33090f05889d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:05.547608 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:05.552054 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4d1dff7-3110-417b-a3a3-33090f05889d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:05.553050 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4d1dff7-3110-417b-a3a3-33090f05889d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:05.553459 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8376ba6d-75c3-4694-b884-fc4da9bd2a9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:05.554410 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8376ba6d-75c3-4694-b884-fc4da9bd2a9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:05.554538 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4d1dff7-3110-417b-a3a3-33090f05889d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:05.556407 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4d1dff7-3110-417b-a3a3-33090f05889d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:05.557025 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4d1dff7-3110-417b-a3a3-33090f05889d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:05.557762 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a4d1dff7-3110-417b-a3a3-33090f05889d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:05.567176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8376ba6d-75c3-4694-b884-fc4da9bd2a9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:05.568374 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8376ba6d-75c3-4694-b884-fc4da9bd2a9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:05.569286 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8376ba6d-75c3-4694-b884-fc4da9bd2a9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:05.570149 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8376ba6d-75c3-4694-b884-fc4da9bd2a9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:05.570866 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8376ba6d-75c3-4694-b884-fc4da9bd2a9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:05.571352 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8376ba6d-75c3-4694-b884-fc4da9bd2a9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:05.607919 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:05.802805 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8376ba6d-75c3-4694-b884-fc4da9bd2a9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:05.811582 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8376ba6d-75c3-4694-b884-fc4da9bd2a9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:05.813447 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8376ba6d-75c3-4694-b884-fc4da9bd2a9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:05.815301 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8376ba6d-75c3-4694-b884-fc4da9bd2a9a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.271176 Sep 26 05:34:05.817273 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a4d1dff7-3110-417b-a3a3-33090f05889d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:05.828705 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a4d1dff7-3110-417b-a3a3-33090f05889d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.290805 Sep 26 05:34:05.828928 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 299/624] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:05 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:34:05.837795 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 326/625] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:05 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:06.842366 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-78f42156-0811-4b62-89f9-0131f4950b34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:06.843611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-78f42156-0811-4b62-89f9-0131f4950b34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:06.856711 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-100e1cdd-c2d1-43c2-be57-c44065eb4244 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:06.857492 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-100e1cdd-c2d1-43c2-be57-c44065eb4244 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:06.862572 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-78f42156-0811-4b62-89f9-0131f4950b34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:06.863350 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-78f42156-0811-4b62-89f9-0131f4950b34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:06.864150 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-78f42156-0811-4b62-89f9-0131f4950b34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:06.867157 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-100e1cdd-c2d1-43c2-be57-c44065eb4244 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:06.868428 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-78f42156-0811-4b62-89f9-0131f4950b34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:06.869355 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-78f42156-0811-4b62-89f9-0131f4950b34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:06.869949 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-100e1cdd-c2d1-43c2-be57-c44065eb4244 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:06.870675 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-78f42156-0811-4b62-89f9-0131f4950b34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:06.871481 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-100e1cdd-c2d1-43c2-be57-c44065eb4244 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:06.873336 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-100e1cdd-c2d1-43c2-be57-c44065eb4244 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:06.874461 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-100e1cdd-c2d1-43c2-be57-c44065eb4244 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:06.876466 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-100e1cdd-c2d1-43c2-be57-c44065eb4244 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:07.372982 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-100e1cdd-c2d1-43c2-be57-c44065eb4244 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:07.385799 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-100e1cdd-c2d1-43c2-be57-c44065eb4244 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.533988 Sep 26 05:34:07.386889 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 327/626] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:06 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:34:07.535820 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-78f42156-0811-4b62-89f9-0131f4950b34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:07.544152 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-78f42156-0811-4b62-89f9-0131f4950b34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:07.545638 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-78f42156-0811-4b62-89f9-0131f4950b34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:07.546792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-78f42156-0811-4b62-89f9-0131f4950b34 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1723 microversion: 2.20 time: 0.709342 Sep 26 05:34:07.547346 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 300/627] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:06 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1723 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:34:08.411952 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-90cc753f-f353-4350-bf78-0ae1d0bda075 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:08.411952 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-90cc753f-f353-4350-bf78-0ae1d0bda075 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:08.425199 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-90cc753f-f353-4350-bf78-0ae1d0bda075 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:08.427884 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-90cc753f-f353-4350-bf78-0ae1d0bda075 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:08.429803 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-90cc753f-f353-4350-bf78-0ae1d0bda075 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:08.431518 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-90cc753f-f353-4350-bf78-0ae1d0bda075 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:08.433204 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-90cc753f-f353-4350-bf78-0ae1d0bda075 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:08.434740 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-90cc753f-f353-4350-bf78-0ae1d0bda075 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:08.454513 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-927c051a-6d63-44da-9556-b3fbcc22085a req-7a420ee9-423b-4a05-b612-04a3deb4c048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffa337e-39e1-4edc-9a0d-4468ff05c577", "name": "network-vif-deleted", "tag": "db14dfec-952b-46e2-9617-72801c005bb3"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:08.481146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=32 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:08.482984 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-927c051a-6d63-44da-9556-b3fbcc22085a req-7a420ee9-423b-4a05-b612-04a3deb4c048 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:08.483463 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-927c051a-6d63-44da-9556-b3fbcc22085a req-7a420ee9-423b-4a05-b612-04a3deb4c048 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:08.497124 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-927c051a-6d63-44da-9556-b3fbcc22085a req-7a420ee9-423b-4a05-b612-04a3deb4c048 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:08.523065 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-927c051a-6d63-44da-9556-b3fbcc22085a req-7a420ee9-423b-4a05-b612-04a3deb4c048 service nova] Creating event network-vif-deleted:db14dfec-952b-46e2-9617-72801c005bb3 for instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 on hv-cinder-85918 Sep 26 05:34:08.534087 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-927c051a-6d63-44da-9556-b3fbcc22085a req-7a420ee9-423b-4a05-b612-04a3deb4c048 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083310 Sep 26 05:34:08.536874 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 301/628] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:34:08.578577 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-030cb2b3-b70b-4389-8035-be2377bc6ebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:08.579296 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-030cb2b3-b70b-4389-8035-be2377bc6ebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:08.608594 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-030cb2b3-b70b-4389-8035-be2377bc6ebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:08.609083 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-030cb2b3-b70b-4389-8035-be2377bc6ebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:08.614682 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-030cb2b3-b70b-4389-8035-be2377bc6ebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:08.615617 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-030cb2b3-b70b-4389-8035-be2377bc6ebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:08.616240 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-030cb2b3-b70b-4389-8035-be2377bc6ebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:08.616837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-030cb2b3-b70b-4389-8035-be2377bc6ebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:08.696327 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-030cb2b3-b70b-4389-8035-be2377bc6ebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:08.696940 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-030cb2b3-b70b-4389-8035-be2377bc6ebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:08.697396 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-030cb2b3-b70b-4389-8035-be2377bc6ebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:08.698029 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-030cb2b3-b70b-4389-8035-be2377bc6ebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lazy-loading 'fault' on Instance uuid 6ffa337e-39e1-4edc-9a0d-4468ff05c577 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:34:08.783891 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-030cb2b3-b70b-4389-8035-be2377bc6ebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:08.795534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-030cb2b3-b70b-4389-8035-be2377bc6ebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:08.802646 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-030cb2b3-b70b-4389-8035-be2377bc6ebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:08.804196 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-030cb2b3-b70b-4389-8035-be2377bc6ebf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 200 len: 1372 microversion: 2.20 time: 0.234072 Sep 26 05:34:08.808024 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 302/629] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:08 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 1372 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:34:08.951005 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-90cc753f-f353-4350-bf78-0ae1d0bda075 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:08.967807 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-90cc753f-f353-4350-bf78-0ae1d0bda075 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.561361 Sep 26 05:34:08.982379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 328/630] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:08 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:09.841965 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7cdcc65b-6499-471b-a34d-b21a60eb1b69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:09.843486 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7cdcc65b-6499-471b-a34d-b21a60eb1b69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:09.855394 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7cdcc65b-6499-471b-a34d-b21a60eb1b69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:09.856158 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7cdcc65b-6499-471b-a34d-b21a60eb1b69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:09.856840 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7cdcc65b-6499-471b-a34d-b21a60eb1b69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:09.857896 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7cdcc65b-6499-471b-a34d-b21a60eb1b69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:09.858509 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7cdcc65b-6499-471b-a34d-b21a60eb1b69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:09.859369 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7cdcc65b-6499-471b-a34d-b21a60eb1b69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:09.888058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-7cdcc65b-6499-471b-a34d-b21a60eb1b69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] HTTP exception thrown: Instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 could not be found. Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7cdcc65b-6499-471b-a34d-b21a60eb1b69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Request method failure captured: Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 HTTP/1.1 Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTiz2OmkTjdhxQJsvp9AVg2qQXBTZ-PRHUznl8AJKUgptoto2TwSgLS73ZYL-evFaBq0DgJkMkFXRxXWUZWefH6H5ExxHVMWzDk_BuJEwSgqsv-0uVI3SzKbWkJ_JNxWsw-EibM9a4_eC14ss1y5nzjMd5ds-wkso_y588pyQPqJgVk Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: e5e1c15ae90e4b82b4e216b3a0549e2e Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1107555367 Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:34:09.890365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:34:09.892106 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e5e1c15ae90e4b82b4e216b3a0549e2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5e1c15ae90e4b82b4e216b3a0549e2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5e1c15ae90e4b82b4e216b3a0549e2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e5e1c15ae90e4b82b4e216b3a0549e2e"}]}] Sep 26 05:34:09.892106 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1107555367 Sep 26 05:34:09.892106 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: e5e1c15ae90e4b82b4e216b3a0549e2e Sep 26 05:34:09.892106 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1107555367 Sep 26 05:34:09.892106 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeShelveTestJSON-1107555367-project Sep 26 05:34:09.892106 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:34:09.892106 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:34:09.892106 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: a8f59b47841a4b62b8e368562c7bd210 Sep 26 05:34:09.892106 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1107555367-project Sep 26 05:34:09.892106 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:34:09.892106 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 could not be found. Sep 26 05:34:09.892106 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': '6ffa337e-39e1-4edc-9a0d-4468ff05c577'} Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 could not be found. Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:34:09.893074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:34:09.894779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:34:09.894779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:34:09.894779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:34:09.894779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:34:09.894779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:34:09.894779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:34:09.894779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:34:09.894779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 could not be found. Sep 26 05:34:09.894779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:34:09.894779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:34:09.894779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:34:09.894779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:34:09.894779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:34:09.894779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:34:09.894779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:34:09.894779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:34:09.894779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 could not be found. Sep 26 05:34:09.894779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:34:09.899367 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7cdcc65b-6499-471b-a34d-b21a60eb1b69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Returning 404 to user: Instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:34:09.900587 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7cdcc65b-6499-471b-a34d-b21a60eb1b69 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 404 len: 111 microversion: 2.20 time: 0.065339 Sep 26 05:34:09.901727 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 303/631] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:09 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 05:34:09.917562 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6d88fb33-1cfb-4b92-8849-47efb6ca2f48 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '.version_select at 0x7fd7b7229430>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:09.949372 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6d88fb33-1cfb-4b92-8849-47efb6ca2f48 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146200819" status: 204 len: 0 microversion: 2.20 time: 0.042758 Sep 26 05:34:09.954666 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 329/632] 10.222.0.49 () {60 vars in 1262 bytes} [Mon Sep 26 05:34:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146200819 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 05:34:09.994401 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f090497f-3a95-4dea-874c-a0a04410d342 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:09.995026 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f090497f-3a95-4dea-874c-a0a04410d342 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:10.005556 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f090497f-3a95-4dea-874c-a0a04410d342 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:10.006046 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f090497f-3a95-4dea-874c-a0a04410d342 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:10.009331 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f090497f-3a95-4dea-874c-a0a04410d342 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:10.010313 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f090497f-3a95-4dea-874c-a0a04410d342 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:10.013499 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f090497f-3a95-4dea-874c-a0a04410d342 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:10.014527 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f090497f-3a95-4dea-874c-a0a04410d342 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:10.235836 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f090497f-3a95-4dea-874c-a0a04410d342 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:10.247071 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f090497f-3a95-4dea-874c-a0a04410d342 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.258959 Sep 26 05:34:10.252857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 304/633] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:09 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:10.901392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-4b085655-8ce3-4624-81f7-223e37351bf8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Action: 'create', calling method: .version_select at 0x7fd7b726d5e0>, body: {"keypair": {"name": "tempest-keypair-582591418", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtAbqBQJqsB+NA9JZRxJsW34ykv81lciTGlQQDIw7gIt3d8fldqCr/z/dzkcxkniCgfQ4MgUtMxOULND1hbwq+xzwXBjeyO8L/OvrI/8jCVlPn1QpUy/a3oW0iVn3tcXQ=="}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:10.921430 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-4b085655-8ce3-4624-81f7-223e37351bf8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Getting quotas for project e5e1c15ae90e4b82b4e216b3a0549e2e. Resources: {'key_pairs'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:34:10.926960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-4b085655-8ce3-4624-81f7-223e37351bf8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Getting quotas for user a8f59b47841a4b62b8e368562c7bd210 and project e5e1c15ae90e4b82b4e216b3a0549e2e. Resources: {'key_pairs'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:34:10.955064 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-4b085655-8ce3-4624-81f7-223e37351bf8 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.057705 Sep 26 05:34:10.962536 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 330/634] 10.222.0.49 () {62 vars in 1200 bytes} [Mon Sep 26 05:34:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 26 05:34:11.275995 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0c77e733-4452-4a34-90a1-8852c0fb6885 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:11.278007 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0c77e733-4452-4a34-90a1-8852c0fb6885 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:11.291313 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0c77e733-4452-4a34-90a1-8852c0fb6885 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:11.294130 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0c77e733-4452-4a34-90a1-8852c0fb6885 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:11.295133 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0c77e733-4452-4a34-90a1-8852c0fb6885 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:11.297321 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0c77e733-4452-4a34-90a1-8852c0fb6885 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:11.298104 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0c77e733-4452-4a34-90a1-8852c0fb6885 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:11.299043 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0c77e733-4452-4a34-90a1-8852c0fb6885 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:11.514830 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0c77e733-4452-4a34-90a1-8852c0fb6885 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:11.528212 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0c77e733-4452-4a34-90a1-8852c0fb6885 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.258771 Sep 26 05:34:11.546805 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 305/635] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:11 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:12.555406 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4e14666e-58f1-4e4a-bf90-848cba40814d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:12.556330 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4e14666e-58f1-4e4a-bf90-848cba40814d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:12.575744 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4e14666e-58f1-4e4a-bf90-848cba40814d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:12.576333 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4e14666e-58f1-4e4a-bf90-848cba40814d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:12.576788 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4e14666e-58f1-4e4a-bf90-848cba40814d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:12.577481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4e14666e-58f1-4e4a-bf90-848cba40814d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:12.577926 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4e14666e-58f1-4e4a-bf90-848cba40814d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:12.578351 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4e14666e-58f1-4e4a-bf90-848cba40814d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:12.730373 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-653ddf9c-a9c6-45db-93c4-6ba921e2d614 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Action: 'create', calling method: .version_select at 0x7fd7b726d940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-641338499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfIKVnaIWe8MqdmW2cJSxTCflFVsq4dTck++MjlfE0nRjbEkeiQBp1+L54q4BbMIzGvwkjAUUh2qMO6G10uYS3mogVbINlQR+zgTa6/457Gh6wLYkVjdgHuIoxV5R2onQ=="}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:12.764410 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-653ddf9c-a9c6-45db-93c4-6ba921e2d614 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Getting quotas for project 774c63ee5fc74c619f63c64590c154e4. Resources: {'key_pairs'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:34:12.769513 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-653ddf9c-a9c6-45db-93c4-6ba921e2d614 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Getting quotas for user 57daecc890ac421b8eb7b5fb4bf25411 and project 774c63ee5fc74c619f63c64590c154e4. Resources: {'key_pairs'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:34:12.817145 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-653ddf9c-a9c6-45db-93c4-6ba921e2d614 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.275988 Sep 26 05:34:12.845498 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 331/636] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 05:34:12 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:34:12.909713 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4e14666e-58f1-4e4a-bf90-848cba40814d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:12.923472 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4e14666e-58f1-4e4a-bf90-848cba40814d tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.370414 Sep 26 05:34:12.926143 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 306/637] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:12 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:13.464038 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-24a3e617-a071-48de-83fc-952006112766 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1590269462", "imageRef": "d37a4f3d-6311-48af-9e33-4c62c14cdd1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a033fac-5647-47c1-8abf-96bf265545b0"}], "security_groups": [{"name": "tempest-securitygroup--1283004950"}], "key_name": "tempest-keypair-582591418", "user_data": "}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:13.618684 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.network.neutron [None req-24a3e617-a071-48de-83fc-952006112766 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] validate_networks() for [('7a033fac-5647-47c1-8abf-96bf265545b0', None, None, None, None, None)] {{(pid=120806) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:34:13.951922 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6af183e6-583a-4675-bb39-5ae3db306b51 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:13.952686 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6af183e6-583a-4675-bb39-5ae3db306b51 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:13.959759 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6af183e6-583a-4675-bb39-5ae3db306b51 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:13.960504 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6af183e6-583a-4675-bb39-5ae3db306b51 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:13.961133 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6af183e6-583a-4675-bb39-5ae3db306b51 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:13.962049 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6af183e6-583a-4675-bb39-5ae3db306b51 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:13.962509 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6af183e6-583a-4675-bb39-5ae3db306b51 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:13.962933 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6af183e6-583a-4675-bb39-5ae3db306b51 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:14.518824 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-24a3e617-a071-48de-83fc-952006112766 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Flavor limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:34:14.520303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-24a3e617-a071-48de-83fc-952006112766 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Image limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:34:14.520900 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-24a3e617-a071-48de-83fc-952006112766 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Flavor pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:34:14.521502 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-24a3e617-a071-48de-83fc-952006112766 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Image pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:34:14.521950 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-24a3e617-a071-48de-83fc-952006112766 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:34:14.534124 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-24a3e617-a071-48de-83fc-952006112766 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:14.534668 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-24a3e617-a071-48de-83fc-952006112766 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:14.535369 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-24a3e617-a071-48de-83fc-952006112766 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:14.535839 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-24a3e617-a071-48de-83fc-952006112766 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:14.536312 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-24a3e617-a071-48de-83fc-952006112766 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:14.536785 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-24a3e617-a071-48de-83fc-952006112766 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:14.557201 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-24a3e617-a071-48de-83fc-952006112766 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Getting quotas for project e5e1c15ae90e4b82b4e216b3a0549e2e. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:34:14.561422 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-24a3e617-a071-48de-83fc-952006112766 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Getting quotas for user a8f59b47841a4b62b8e368562c7bd210 and project e5e1c15ae90e4b82b4e216b3a0549e2e. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:34:14.574423 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-24a3e617-a071-48de-83fc-952006112766 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Going to run 1 instances... {{(pid=120806) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:34:14.577159 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-24a3e617-a071-48de-83fc-952006112766 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d37a4f3d-6311-48af-9e33-4c62c14cdd1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120806) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:34:14.583670 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6af183e6-583a-4675-bb39-5ae3db306b51 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:14.597727 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6af183e6-583a-4675-bb39-5ae3db306b51 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.649915 Sep 26 05:34:14.598439 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 307/638] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:13 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:14.630473 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-24a3e617-a071-48de-83fc-952006112766 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.173830 Sep 26 05:34:14.631110 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 332/639] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Sep 26 05:34:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 26 05:34:14.642907 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fb2a0b38-3ae9-4321-a1ee-04e32c4a8f7e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:14.643514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fb2a0b38-3ae9-4321-a1ee-04e32c4a8f7e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:14.722550 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fb2a0b38-3ae9-4321-a1ee-04e32c4a8f7e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:14.736330 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fb2a0b38-3ae9-4321-a1ee-04e32c4a8f7e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:14.737973 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fb2a0b38-3ae9-4321-a1ee-04e32c4a8f7e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:14.739096 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fb2a0b38-3ae9-4321-a1ee-04e32c4a8f7e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1281 microversion: 2.20 time: 0.100217 Sep 26 05:34:14.744395 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 308/640] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:14 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1281 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:34:15.630757 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f163dc12-3a16-4006-b99b-dc3ccdbfbdf5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:15.631396 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f163dc12-3a16-4006-b99b-dc3ccdbfbdf5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:15.640920 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f163dc12-3a16-4006-b99b-dc3ccdbfbdf5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:15.641470 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f163dc12-3a16-4006-b99b-dc3ccdbfbdf5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:15.642453 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f163dc12-3a16-4006-b99b-dc3ccdbfbdf5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:15.643252 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f163dc12-3a16-4006-b99b-dc3ccdbfbdf5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:15.643889 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f163dc12-3a16-4006-b99b-dc3ccdbfbdf5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:15.644345 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f163dc12-3a16-4006-b99b-dc3ccdbfbdf5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:15.767785 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-044f7657-416a-4f32-b437-9c7ca61cf079 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:15.768581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-044f7657-416a-4f32-b437-9c7ca61cf079 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:15.779809 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-044f7657-416a-4f32-b437-9c7ca61cf079 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:15.780523 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-044f7657-416a-4f32-b437-9c7ca61cf079 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:15.787413 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-044f7657-416a-4f32-b437-9c7ca61cf079 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:15.788340 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-044f7657-416a-4f32-b437-9c7ca61cf079 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:15.789592 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-044f7657-416a-4f32-b437-9c7ca61cf079 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:15.790191 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-044f7657-416a-4f32-b437-9c7ca61cf079 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:15.803139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f163dc12-3a16-4006-b99b-dc3ccdbfbdf5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:15.813256 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f163dc12-3a16-4006-b99b-dc3ccdbfbdf5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1736 microversion: 2.1 time: 0.192467 Sep 26 05:34:15.814028 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 333/641] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:15 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:34:15.877582 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-044f7657-416a-4f32-b437-9c7ca61cf079 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:15.886616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-044f7657-416a-4f32-b437-9c7ca61cf079 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:15.888332 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-044f7657-416a-4f32-b437-9c7ca61cf079 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:15.889550 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-044f7657-416a-4f32-b437-9c7ca61cf079 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1333 microversion: 2.20 time: 0.125855 Sep 26 05:34:15.890252 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 309/642] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:15 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1333 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:34:16.839734 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-ab6df57d-e726-45ea-9bdb-9d9d8fc6fb41 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:16.841137 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-ab6df57d-e726-45ea-9bdb-9d9d8fc6fb41 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:16.849118 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ab6df57d-e726-45ea-9bdb-9d9d8fc6fb41 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:16.849869 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ab6df57d-e726-45ea-9bdb-9d9d8fc6fb41 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:16.850665 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ab6df57d-e726-45ea-9bdb-9d9d8fc6fb41 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:16.851499 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ab6df57d-e726-45ea-9bdb-9d9d8fc6fb41 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:16.851988 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ab6df57d-e726-45ea-9bdb-9d9d8fc6fb41 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:16.852425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ab6df57d-e726-45ea-9bdb-9d9d8fc6fb41 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:16.916343 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7524e5b5-caa6-45d1-9540-3337a32c4279 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:16.917047 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7524e5b5-caa6-45d1-9540-3337a32c4279 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:16.923693 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7524e5b5-caa6-45d1-9540-3337a32c4279 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:16.924070 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7524e5b5-caa6-45d1-9540-3337a32c4279 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:16.924547 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7524e5b5-caa6-45d1-9540-3337a32c4279 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:16.933332 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7524e5b5-caa6-45d1-9540-3337a32c4279 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:16.934637 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7524e5b5-caa6-45d1-9540-3337a32c4279 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:16.935098 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7524e5b5-caa6-45d1-9540-3337a32c4279 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:17.022136 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7524e5b5-caa6-45d1-9540-3337a32c4279 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:17.030775 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7524e5b5-caa6-45d1-9540-3337a32c4279 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:17.032022 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7524e5b5-caa6-45d1-9540-3337a32c4279 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:17.033357 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7524e5b5-caa6-45d1-9540-3337a32c4279 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1333 microversion: 2.20 time: 0.121152 Sep 26 05:34:17.047487 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 310/643] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:16 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1333 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:34:17.054931 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-ab6df57d-e726-45ea-9bdb-9d9d8fc6fb41 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:17.063757 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-ab6df57d-e726-45ea-9bdb-9d9d8fc6fb41 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1716 microversion: 2.1 time: 0.229519 Sep 26 05:34:17.068714 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 334/644] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:16 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1716 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:17.205941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a97608a6-86db-494a-88c3-3fe9ef5b88db tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:17.206366 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a97608a6-86db-494a-88c3-3fe9ef5b88db tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:17.214610 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a97608a6-86db-494a-88c3-3fe9ef5b88db tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:17.215326 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a97608a6-86db-494a-88c3-3fe9ef5b88db tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:17.215956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a97608a6-86db-494a-88c3-3fe9ef5b88db tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:17.216964 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a97608a6-86db-494a-88c3-3fe9ef5b88db tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:17.217575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a97608a6-86db-494a-88c3-3fe9ef5b88db tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:17.218159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a97608a6-86db-494a-88c3-3fe9ef5b88db tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-a97608a6-86db-494a-88c3-3fe9ef5b88db tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] HTTP exception thrown: Cannot 'detach_volume' instance 30c51093-517b-4a33-9d80-8bf0e1747e75 while it is in vm_state rescued Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a97608a6-86db-494a-88c3-3fe9ef5b88db tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Request method failure captured: Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: DELETE /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/os-volume_attachments/6b54d688-fb3b-40b0-b495-613a548f923d HTTP/1.1 Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTivBvtiLsDynVA2bAKI90oygZ30ioDR3YG_muA8Xt1hjZBfVOLnnIKeLoTKxZiO69-Ddx_DTOJh3FNG9fup9oSLVndq9WzArQ-VSQsJcXJKLTFn5mH1QcjR7BSlyztXNqEUpmqs3NzmftHVS2Zaxk0_x4Yll5AojazwDK2lCvQJ3as Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: 01c8f7766cb646b7b646a53c9de8e91a Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1282050550 Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:34:17.339575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:34:17.341322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01c8f7766cb646b7b646a53c9de8e91a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01c8f7766cb646b7b646a53c9de8e91a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01c8f7766cb646b7b646a53c9de8e91a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01c8f7766cb646b7b646a53c9de8e91a"}]}] Sep 26 05:34:17.341322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1282050550 Sep 26 05:34:17.341322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 01c8f7766cb646b7b646a53c9de8e91a Sep 26 05:34:17.341322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1282050550 Sep 26 05:34:17.341322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-ServerRescueNegativeTestJSON-1282050550-project Sep 26 05:34:17.341322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:34:17.341322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:34:17.341322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 683c4d41fa4a452ba8210e62dd43f7f4 Sep 26 05:34:17.341322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1282050550-project Sep 26 05:34:17.341322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:34:17.341322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Cannot 'detach_volume' instance 30c51093-517b-4a33-9d80-8bf0e1747e75 while it is in vm_state rescued Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'server_id': '30c51093-517b-4a33-9d80-8bf0e1747e75', 'id': '6b54d688-fb3b-40b0-b495-613a548f923d'} Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 30c51093-517b-4a33-9d80-8bf0e1747e75 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:34:17.342109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:34:17.343476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 26 05:34:17.343476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 26 05:34:17.343476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 26 05:34:17.343476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 26 05:34:17.343476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 30c51093-517b-4a33-9d80-8bf0e1747e75 while it is in vm_state rescued Sep 26 05:34:17.343476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:34:17.343476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:34:17.343476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:34:17.343476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:34:17.343476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:34:17.343476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:34:17.343476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:34:17.343476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:34:17.343476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 30c51093-517b-4a33-9d80-8bf0e1747e75 while it is in vm_state rescued Sep 26 05:34:17.343476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:34:17.343476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a97608a6-86db-494a-88c3-3fe9ef5b88db tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Returning 409 to user: Cannot 'detach_volume' instance 30c51093-517b-4a33-9d80-8bf0e1747e75 while it is in vm_state rescued {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:34:17.344804 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a97608a6-86db-494a-88c3-3fe9ef5b88db tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "DELETE /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/os-volume_attachments/6b54d688-fb3b-40b0-b495-613a548f923d" status: 409 len: 152 microversion: 2.1 time: 0.136000 Sep 26 05:34:17.344804 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 311/645] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 05:34:17 2022] DELETE /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/os-volume_attachments/6b54d688-fb3b-40b0-b495-613a548f923d => generated 152 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 26 05:34:17.347283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b0cd944d-f38c-4369-ba8b-ee17f2cb3e1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:17.347895 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b0cd944d-f38c-4369-ba8b-ee17f2cb3e1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:17.354984 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b0cd944d-f38c-4369-ba8b-ee17f2cb3e1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:17.355482 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b0cd944d-f38c-4369-ba8b-ee17f2cb3e1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:17.355924 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b0cd944d-f38c-4369-ba8b-ee17f2cb3e1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:17.356675 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b0cd944d-f38c-4369-ba8b-ee17f2cb3e1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:17.357133 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b0cd944d-f38c-4369-ba8b-ee17f2cb3e1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:17.357556 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b0cd944d-f38c-4369-ba8b-ee17f2cb3e1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:17.454008 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b0cd944d-f38c-4369-ba8b-ee17f2cb3e1b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "POST /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/action" status: 202 len: 0 microversion: 2.1 time: 0.110623 Sep 26 05:34:17.457931 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 335/646] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 05:34:17 2022] POST /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:34:17.465745 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c8d04037-170c-4e16-883a-aaab4b79ac2b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:17.466365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c8d04037-170c-4e16-883a-aaab4b79ac2b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:17.482737 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c8d04037-170c-4e16-883a-aaab4b79ac2b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:17.483355 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c8d04037-170c-4e16-883a-aaab4b79ac2b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:17.484513 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c8d04037-170c-4e16-883a-aaab4b79ac2b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:17.485303 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c8d04037-170c-4e16-883a-aaab4b79ac2b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:17.485796 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c8d04037-170c-4e16-883a-aaab4b79ac2b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:17.486225 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c8d04037-170c-4e16-883a-aaab4b79ac2b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:17.717667 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c8d04037-170c-4e16-883a-aaab4b79ac2b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:17.726065 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c8d04037-170c-4e16-883a-aaab4b79ac2b tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1724 microversion: 2.1 time: 0.266762 Sep 26 05:34:17.728426 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 312/647] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:17 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:18.058440 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1e5b48ea-65cf-401d-8781-c8456b6b4607 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:18.059795 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-1e5b48ea-65cf-401d-8781-c8456b6b4607 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:18.081718 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1e5b48ea-65cf-401d-8781-c8456b6b4607 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:18.082831 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1e5b48ea-65cf-401d-8781-c8456b6b4607 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:18.096169 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1e5b48ea-65cf-401d-8781-c8456b6b4607 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:18.096882 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1e5b48ea-65cf-401d-8781-c8456b6b4607 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:18.097365 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1e5b48ea-65cf-401d-8781-c8456b6b4607 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:18.099464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1e5b48ea-65cf-401d-8781-c8456b6b4607 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:18.208583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1e5b48ea-65cf-401d-8781-c8456b6b4607 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:18.219348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1e5b48ea-65cf-401d-8781-c8456b6b4607 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:18.220864 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1e5b48ea-65cf-401d-8781-c8456b6b4607 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:18.222103 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1e5b48ea-65cf-401d-8781-c8456b6b4607 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1339 microversion: 2.20 time: 0.168605 Sep 26 05:34:18.222729 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 336/648] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:18 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1339 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:34:18.750300 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a13af68b-877f-439b-a9f7-c3a5459ec3ff tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:18.751659 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a13af68b-877f-439b-a9f7-c3a5459ec3ff tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:18.758941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a13af68b-877f-439b-a9f7-c3a5459ec3ff tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:18.759420 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a13af68b-877f-439b-a9f7-c3a5459ec3ff tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:18.760027 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a13af68b-877f-439b-a9f7-c3a5459ec3ff tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:18.760908 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a13af68b-877f-439b-a9f7-c3a5459ec3ff tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:18.761385 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a13af68b-877f-439b-a9f7-c3a5459ec3ff tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:18.761799 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a13af68b-877f-439b-a9f7-c3a5459ec3ff tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:18.983220 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a13af68b-877f-439b-a9f7-c3a5459ec3ff tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:18.991502 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a13af68b-877f-439b-a9f7-c3a5459ec3ff tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1724 microversion: 2.1 time: 0.245086 Sep 26 05:34:18.992162 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 313/649] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:18 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:19.249114 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-4e361171-1f53-4588-aaec-6bf29df970dc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:19.249727 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-4e361171-1f53-4588-aaec-6bf29df970dc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:19.256194 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4e361171-1f53-4588-aaec-6bf29df970dc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:19.256708 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4e361171-1f53-4588-aaec-6bf29df970dc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:19.257138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4e361171-1f53-4588-aaec-6bf29df970dc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:19.258545 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4e361171-1f53-4588-aaec-6bf29df970dc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:19.259003 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4e361171-1f53-4588-aaec-6bf29df970dc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:19.259419 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4e361171-1f53-4588-aaec-6bf29df970dc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:19.349996 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-670c6074-ead8-4228-8dc2-cde4bcb8a6ea req-42155e98-c641-4155-8afc-6f3bc0edcbf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e", "tag": "d2d361e4-87bf-4197-9996-68e762a01ce3"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:19.361088 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-670c6074-ead8-4228-8dc2-cde4bcb8a6ea req-42155e98-c641-4155-8afc-6f3bc0edcbf5 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:19.361562 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-670c6074-ead8-4228-8dc2-cde4bcb8a6ea req-42155e98-c641-4155-8afc-6f3bc0edcbf5 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:19.361989 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-670c6074-ead8-4228-8dc2-cde4bcb8a6ea req-42155e98-c641-4155-8afc-6f3bc0edcbf5 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:19.373436 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-670c6074-ead8-4228-8dc2-cde4bcb8a6ea req-42155e98-c641-4155-8afc-6f3bc0edcbf5 service nova] Creating event network-changed:d2d361e4-87bf-4197-9996-68e762a01ce3 for instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e on hv-cinder-85918 Sep 26 05:34:19.378216 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-670c6074-ead8-4228-8dc2-cde4bcb8a6ea req-42155e98-c641-4155-8afc-6f3bc0edcbf5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031993 Sep 26 05:34:19.378807 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 314/650] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:34:19.454743 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-4e361171-1f53-4588-aaec-6bf29df970dc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:19.458332 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:19.465101 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-4e361171-1f53-4588-aaec-6bf29df970dc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:19.466592 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-4e361171-1f53-4588-aaec-6bf29df970dc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:19.467683 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-4e361171-1f53-4588-aaec-6bf29df970dc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1407 microversion: 2.20 time: 0.222647 Sep 26 05:34:19.468227 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 337/651] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:19 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:34:20.072668 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-50953fe3-7d8c-4b52-86ff-f64724eee581 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:20.073376 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-50953fe3-7d8c-4b52-86ff-f64724eee581 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:20.079545 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-50953fe3-7d8c-4b52-86ff-f64724eee581 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:20.080027 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-50953fe3-7d8c-4b52-86ff-f64724eee581 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:20.080491 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-50953fe3-7d8c-4b52-86ff-f64724eee581 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:20.081204 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-50953fe3-7d8c-4b52-86ff-f64724eee581 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:20.081656 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-50953fe3-7d8c-4b52-86ff-f64724eee581 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:20.082073 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-50953fe3-7d8c-4b52-86ff-f64724eee581 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:20.212952 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-50953fe3-7d8c-4b52-86ff-f64724eee581 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:20.221152 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-50953fe3-7d8c-4b52-86ff-f64724eee581 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1724 microversion: 2.1 time: 0.209853 Sep 26 05:34:20.221719 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 315/652] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:20 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:20.494915 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-20364141-692d-4fab-b716-d8fd93599a09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:20.495523 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-20364141-692d-4fab-b716-d8fd93599a09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:20.503124 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20364141-692d-4fab-b716-d8fd93599a09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:20.503605 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20364141-692d-4fab-b716-d8fd93599a09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:20.504041 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20364141-692d-4fab-b716-d8fd93599a09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:20.504754 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20364141-692d-4fab-b716-d8fd93599a09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:20.505205 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20364141-692d-4fab-b716-d8fd93599a09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:20.505627 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20364141-692d-4fab-b716-d8fd93599a09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:20.638695 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-20364141-692d-4fab-b716-d8fd93599a09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:20.646844 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-20364141-692d-4fab-b716-d8fd93599a09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:20.648834 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-20364141-692d-4fab-b716-d8fd93599a09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:20.649986 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-20364141-692d-4fab-b716-d8fd93599a09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1407 microversion: 2.20 time: 0.160411 Sep 26 05:34:20.650742 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 338/653] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:20 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:34:21.245415 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-81ac786f-d269-432d-a358-89ec8b18d415 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:21.246026 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-81ac786f-d269-432d-a358-89ec8b18d415 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:21.252577 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81ac786f-d269-432d-a358-89ec8b18d415 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:21.253055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81ac786f-d269-432d-a358-89ec8b18d415 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:21.253487 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81ac786f-d269-432d-a358-89ec8b18d415 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:21.254158 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81ac786f-d269-432d-a358-89ec8b18d415 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:21.254604 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81ac786f-d269-432d-a358-89ec8b18d415 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:21.255022 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81ac786f-d269-432d-a358-89ec8b18d415 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:21.403530 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-81ac786f-d269-432d-a358-89ec8b18d415 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:21.412678 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-81ac786f-d269-432d-a358-89ec8b18d415 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1724 microversion: 2.1 time: 0.171128 Sep 26 05:34:21.413279 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 316/654] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:21 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:21.675213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-95290546-bbb7-41d6-b151-75f125f45ec9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:21.675882 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-95290546-bbb7-41d6-b151-75f125f45ec9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:21.683360 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95290546-bbb7-41d6-b151-75f125f45ec9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:21.683841 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95290546-bbb7-41d6-b151-75f125f45ec9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:21.684296 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95290546-bbb7-41d6-b151-75f125f45ec9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:21.684994 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95290546-bbb7-41d6-b151-75f125f45ec9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:21.685439 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95290546-bbb7-41d6-b151-75f125f45ec9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:21.685854 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-95290546-bbb7-41d6-b151-75f125f45ec9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:21.814785 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-95290546-bbb7-41d6-b151-75f125f45ec9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:21.823581 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-95290546-bbb7-41d6-b151-75f125f45ec9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:21.825197 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-95290546-bbb7-41d6-b151-75f125f45ec9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:21.826408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-95290546-bbb7-41d6-b151-75f125f45ec9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1407 microversion: 2.20 time: 0.155311 Sep 26 05:34:21.826969 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 339/655] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:21 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:34:22.436152 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-672e3da1-a931-4d27-b63d-e66653a45496 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:22.436878 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-672e3da1-a931-4d27-b63d-e66653a45496 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:22.443315 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-672e3da1-a931-4d27-b63d-e66653a45496 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:22.443812 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-672e3da1-a931-4d27-b63d-e66653a45496 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:22.444219 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-672e3da1-a931-4d27-b63d-e66653a45496 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:22.444995 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-672e3da1-a931-4d27-b63d-e66653a45496 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:22.445439 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-672e3da1-a931-4d27-b63d-e66653a45496 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:22.445853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-672e3da1-a931-4d27-b63d-e66653a45496 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:22.583540 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-672e3da1-a931-4d27-b63d-e66653a45496 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:22.592691 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-672e3da1-a931-4d27-b63d-e66653a45496 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1730 microversion: 2.1 time: 0.160368 Sep 26 05:34:22.593260 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 317/656] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:22 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:22.615048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-166a473c-ff0f-44df-a23d-f610493eaa02 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:22.615571 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-166a473c-ff0f-44df-a23d-f610493eaa02 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:22.621474 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-166a473c-ff0f-44df-a23d-f610493eaa02 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:22.621896 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-166a473c-ff0f-44df-a23d-f610493eaa02 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:22.622328 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-166a473c-ff0f-44df-a23d-f610493eaa02 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:22.623011 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-166a473c-ff0f-44df-a23d-f610493eaa02 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:22.623465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-166a473c-ff0f-44df-a23d-f610493eaa02 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:22.623893 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-166a473c-ff0f-44df-a23d-f610493eaa02 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:22.701102 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-166a473c-ff0f-44df-a23d-f610493eaa02 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089780 Sep 26 05:34:22.701694 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 340/657] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 05:34:22 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:34:22.907641 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2be0ec82-91e3-4cff-8756-4e549a5bf870 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:22.908295 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2be0ec82-91e3-4cff-8756-4e549a5bf870 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:22.914447 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2be0ec82-91e3-4cff-8756-4e549a5bf870 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:22.914909 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2be0ec82-91e3-4cff-8756-4e549a5bf870 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:22.915335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2be0ec82-91e3-4cff-8756-4e549a5bf870 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:22.916013 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2be0ec82-91e3-4cff-8756-4e549a5bf870 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:22.916488 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2be0ec82-91e3-4cff-8756-4e549a5bf870 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:22.916906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2be0ec82-91e3-4cff-8756-4e549a5bf870 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:23.137157 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2be0ec82-91e3-4cff-8756-4e549a5bf870 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:23.139492 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:23.147132 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2be0ec82-91e3-4cff-8756-4e549a5bf870 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:23.148672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2be0ec82-91e3-4cff-8756-4e549a5bf870 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:23.149773 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2be0ec82-91e3-4cff-8756-4e549a5bf870 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1407 microversion: 2.20 time: 0.301588 Sep 26 05:34:23.150326 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 318/658] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:22 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:34:23.702782 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-8cec17b3-ca33-44ad-a291-93f2bd7d7b28 req-a0d79405-7218-42d6-b684-cec17901598b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c51093-517b-4a33-9d80-8bf0e1747e75", "tag": "322798b9-1af9-46df-bb99-417d8b1d04b3"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:23.714164 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-8cec17b3-ca33-44ad-a291-93f2bd7d7b28 req-a0d79405-7218-42d6-b684-cec17901598b service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:23.714963 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-8cec17b3-ca33-44ad-a291-93f2bd7d7b28 req-a0d79405-7218-42d6-b684-cec17901598b service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:23.715382 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-8cec17b3-ca33-44ad-a291-93f2bd7d7b28 req-a0d79405-7218-42d6-b684-cec17901598b service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:23.728677 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-8cec17b3-ca33-44ad-a291-93f2bd7d7b28 req-a0d79405-7218-42d6-b684-cec17901598b service nova] Creating event network-changed:322798b9-1af9-46df-bb99-417d8b1d04b3 for instance 30c51093-517b-4a33-9d80-8bf0e1747e75 on hv-cinder-85918 Sep 26 05:34:23.733747 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-8cec17b3-ca33-44ad-a291-93f2bd7d7b28 req-a0d79405-7218-42d6-b684-cec17901598b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035935 Sep 26 05:34:23.734333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 341/659] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:34:24.174454 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3e96f3c9-c877-48e8-9629-39cddd1c6613 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:24.175715 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3e96f3c9-c877-48e8-9629-39cddd1c6613 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:24.183148 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e96f3c9-c877-48e8-9629-39cddd1c6613 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:24.183634 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e96f3c9-c877-48e8-9629-39cddd1c6613 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:24.184283 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e96f3c9-c877-48e8-9629-39cddd1c6613 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:24.184980 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e96f3c9-c877-48e8-9629-39cddd1c6613 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:24.185597 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e96f3c9-c877-48e8-9629-39cddd1c6613 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:24.186016 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e96f3c9-c877-48e8-9629-39cddd1c6613 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:24.659355 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3e96f3c9-c877-48e8-9629-39cddd1c6613 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:24.668549 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3e96f3c9-c877-48e8-9629-39cddd1c6613 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:24.669982 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3e96f3c9-c877-48e8-9629-39cddd1c6613 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:24.671103 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3e96f3c9-c877-48e8-9629-39cddd1c6613 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1407 microversion: 2.20 time: 0.500546 Sep 26 05:34:24.671671 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 319/660] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:24 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1407 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:34:25.693438 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:25.694207 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=14 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:25.700357 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e51c38fa-13c6-482d-80f3-722ec9f07432 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:25.701062 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e51c38fa-13c6-482d-80f3-722ec9f07432 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:25.708279 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e51c38fa-13c6-482d-80f3-722ec9f07432 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:25.708773 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e51c38fa-13c6-482d-80f3-722ec9f07432 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:25.709212 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e51c38fa-13c6-482d-80f3-722ec9f07432 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:25.709902 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e51c38fa-13c6-482d-80f3-722ec9f07432 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:25.711335 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e51c38fa-13c6-482d-80f3-722ec9f07432 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:25.711898 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e51c38fa-13c6-482d-80f3-722ec9f07432 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:25.747799 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-3acaa7a8-088a-40ee-92e2-29c819aeee4a req-d3dcd820-fe82-474a-903f-fb683aac22d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c51093-517b-4a33-9d80-8bf0e1747e75", "tag": "322798b9-1af9-46df-bb99-417d8b1d04b3"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:25.752769 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:25.761446 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-3acaa7a8-088a-40ee-92e2-29c819aeee4a req-d3dcd820-fe82-474a-903f-fb683aac22d7 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:25.762015 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-3acaa7a8-088a-40ee-92e2-29c819aeee4a req-d3dcd820-fe82-474a-903f-fb683aac22d7 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:25.762515 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-3acaa7a8-088a-40ee-92e2-29c819aeee4a req-d3dcd820-fe82-474a-903f-fb683aac22d7 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:25.775492 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-3acaa7a8-088a-40ee-92e2-29c819aeee4a req-d3dcd820-fe82-474a-903f-fb683aac22d7 service nova] Creating event network-changed:322798b9-1af9-46df-bb99-417d8b1d04b3 for instance 30c51093-517b-4a33-9d80-8bf0e1747e75 on hv-cinder-85918 Sep 26 05:34:25.781186 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-3acaa7a8-088a-40ee-92e2-29c819aeee4a req-d3dcd820-fe82-474a-903f-fb683aac22d7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036945 Sep 26 05:34:25.782571 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 320/661] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:34:25.911875 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e51c38fa-13c6-482d-80f3-722ec9f07432 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:25.920794 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e51c38fa-13c6-482d-80f3-722ec9f07432 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:25.922222 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e51c38fa-13c6-482d-80f3-722ec9f07432 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:25.923419 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e51c38fa-13c6-482d-80f3-722ec9f07432 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1407 microversion: 2.20 time: 0.230981 Sep 26 05:34:25.924004 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 342/662] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:25 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:34:26.950304 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f0c2e814-3472-4420-b7f0-a03a28b9c845 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:26.951058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f0c2e814-3472-4420-b7f0-a03a28b9c845 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:26.957945 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0c2e814-3472-4420-b7f0-a03a28b9c845 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:26.958424 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0c2e814-3472-4420-b7f0-a03a28b9c845 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:26.958852 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0c2e814-3472-4420-b7f0-a03a28b9c845 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:26.959536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0c2e814-3472-4420-b7f0-a03a28b9c845 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:26.960578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0c2e814-3472-4420-b7f0-a03a28b9c845 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:26.961141 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0c2e814-3472-4420-b7f0-a03a28b9c845 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:27.098125 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f0c2e814-3472-4420-b7f0-a03a28b9c845 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:27.106635 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f0c2e814-3472-4420-b7f0-a03a28b9c845 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:27.108070 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f0c2e814-3472-4420-b7f0-a03a28b9c845 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:27.109198 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f0c2e814-3472-4420-b7f0-a03a28b9c845 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1407 microversion: 2.20 time: 0.163674 Sep 26 05:34:27.109754 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 321/663] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:26 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:34:27.928997 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-4c37dcd5-04f0-4db4-89ee-51cc12570411 req-eaeb8e2d-2cb9-401a-9f56-9a91ae4248ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e", "name": "network-vif-plugged", "status": "completed", "tag": "d2d361e4-87bf-4197-9996-68e762a01ce3"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:27.940571 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-4c37dcd5-04f0-4db4-89ee-51cc12570411 req-eaeb8e2d-2cb9-401a-9f56-9a91ae4248ca service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:27.941051 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-4c37dcd5-04f0-4db4-89ee-51cc12570411 req-eaeb8e2d-2cb9-401a-9f56-9a91ae4248ca service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:27.941486 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-4c37dcd5-04f0-4db4-89ee-51cc12570411 req-eaeb8e2d-2cb9-401a-9f56-9a91ae4248ca service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:27.953467 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-4c37dcd5-04f0-4db4-89ee-51cc12570411 req-eaeb8e2d-2cb9-401a-9f56-9a91ae4248ca service nova] Creating event network-vif-plugged:d2d361e4-87bf-4197-9996-68e762a01ce3 for instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e on hv-cinder-85918 Sep 26 05:34:27.958373 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-4c37dcd5-04f0-4db4-89ee-51cc12570411 req-eaeb8e2d-2cb9-401a-9f56-9a91ae4248ca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033156 Sep 26 05:34:27.959140 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 343/664] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:34:28.135401 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-47bf0434-25ac-447c-8bde-a3c20044bfc3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:28.136101 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-47bf0434-25ac-447c-8bde-a3c20044bfc3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:28.142504 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-47bf0434-25ac-447c-8bde-a3c20044bfc3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:28.142986 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-47bf0434-25ac-447c-8bde-a3c20044bfc3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:28.143424 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-47bf0434-25ac-447c-8bde-a3c20044bfc3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:28.144110 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-47bf0434-25ac-447c-8bde-a3c20044bfc3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:28.144585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-47bf0434-25ac-447c-8bde-a3c20044bfc3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:28.145003 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-47bf0434-25ac-447c-8bde-a3c20044bfc3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:28.312641 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-47bf0434-25ac-447c-8bde-a3c20044bfc3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:28.321262 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-47bf0434-25ac-447c-8bde-a3c20044bfc3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:28.322703 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-47bf0434-25ac-447c-8bde-a3c20044bfc3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:28.323793 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-47bf0434-25ac-447c-8bde-a3c20044bfc3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1407 microversion: 2.20 time: 0.192745 Sep 26 05:34:28.324434 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 322/665] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:28 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:34:29.349285 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-26b82d18-c79e-4655-b1a1-906092733faf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:29.349992 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-26b82d18-c79e-4655-b1a1-906092733faf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:29.356893 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-26b82d18-c79e-4655-b1a1-906092733faf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:29.357406 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-26b82d18-c79e-4655-b1a1-906092733faf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:29.357836 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-26b82d18-c79e-4655-b1a1-906092733faf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:29.358511 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-26b82d18-c79e-4655-b1a1-906092733faf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:29.358956 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-26b82d18-c79e-4655-b1a1-906092733faf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:29.359372 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-26b82d18-c79e-4655-b1a1-906092733faf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:29.487109 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-26b82d18-c79e-4655-b1a1-906092733faf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:29.496543 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-26b82d18-c79e-4655-b1a1-906092733faf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:29.498001 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-26b82d18-c79e-4655-b1a1-906092733faf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:29.499143 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-26b82d18-c79e-4655-b1a1-906092733faf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1407 microversion: 2.20 time: 0.154653 Sep 26 05:34:29.499703 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 344/666] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:29 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:34:30.523930 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-aece8a28-758f-4422-85dd-1f07c2003402 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:30.525120 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-aece8a28-758f-4422-85dd-1f07c2003402 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:30.532022 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aece8a28-758f-4422-85dd-1f07c2003402 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:30.532615 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aece8a28-758f-4422-85dd-1f07c2003402 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:30.533058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aece8a28-758f-4422-85dd-1f07c2003402 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:30.533751 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aece8a28-758f-4422-85dd-1f07c2003402 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:30.534227 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aece8a28-758f-4422-85dd-1f07c2003402 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:30.534686 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aece8a28-758f-4422-85dd-1f07c2003402 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:30.665206 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-aece8a28-758f-4422-85dd-1f07c2003402 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:30.673323 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-aece8a28-758f-4422-85dd-1f07c2003402 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:30.674772 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-aece8a28-758f-4422-85dd-1f07c2003402 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:30.675917 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-aece8a28-758f-4422-85dd-1f07c2003402 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1598 microversion: 2.20 time: 0.156484 Sep 26 05:34:30.676519 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 323/667] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:34:30 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:34:30.701126 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-855e77e0-cd1c-4a2d-8779-d768301b1c3f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:30.701652 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-855e77e0-cd1c-4a2d-8779-d768301b1c3f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:30.707905 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-855e77e0-cd1c-4a2d-8779-d768301b1c3f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:30.708423 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-855e77e0-cd1c-4a2d-8779-d768301b1c3f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:30.708857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-855e77e0-cd1c-4a2d-8779-d768301b1c3f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:30.709543 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-855e77e0-cd1c-4a2d-8779-d768301b1c3f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:30.710022 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-855e77e0-cd1c-4a2d-8779-d768301b1c3f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:30.710445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-855e77e0-cd1c-4a2d-8779-d768301b1c3f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:30.790121 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-855e77e0-cd1c-4a2d-8779-d768301b1c3f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092753 Sep 26 05:34:30.790726 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 345/668] 10.222.0.49 () {60 vars in 1316 bytes} [Mon Sep 26 05:34:30 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:34:31.690463 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-2c0e6767-dc04-4eac-8089-84ad9b3ee9f0 req-ebfcb2d9-ca35-46c4-92c6-450fe3377143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e", "tag": "d2d361e4-87bf-4197-9996-68e762a01ce3"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:31.701186 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-2c0e6767-dc04-4eac-8089-84ad9b3ee9f0 req-ebfcb2d9-ca35-46c4-92c6-450fe3377143 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:31.701582 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-2c0e6767-dc04-4eac-8089-84ad9b3ee9f0 req-ebfcb2d9-ca35-46c4-92c6-450fe3377143 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:31.702072 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-2c0e6767-dc04-4eac-8089-84ad9b3ee9f0 req-ebfcb2d9-ca35-46c4-92c6-450fe3377143 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:31.714287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-2c0e6767-dc04-4eac-8089-84ad9b3ee9f0 req-ebfcb2d9-ca35-46c4-92c6-450fe3377143 service nova] Creating event network-changed:d2d361e4-87bf-4197-9996-68e762a01ce3 for instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e on hv-cinder-85918 Sep 26 05:34:31.719364 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-2c0e6767-dc04-4eac-8089-84ad9b3ee9f0 req-ebfcb2d9-ca35-46c4-92c6-450fe3377143 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032661 Sep 26 05:34:31.720199 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 324/669] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:34:33.809610 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3f4017ec-4922-4154-a3eb-223b577124e2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:33.810184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-3f4017ec-4922-4154-a3eb-223b577124e2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:33.815936 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3f4017ec-4922-4154-a3eb-223b577124e2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:33.816452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3f4017ec-4922-4154-a3eb-223b577124e2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:33.816887 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3f4017ec-4922-4154-a3eb-223b577124e2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:33.817563 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3f4017ec-4922-4154-a3eb-223b577124e2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:33.818013 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3f4017ec-4922-4154-a3eb-223b577124e2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:33.818436 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3f4017ec-4922-4154-a3eb-223b577124e2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:33.901702 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-3f4017ec-4922-4154-a3eb-223b577124e2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lazy-loading 'services' on Instance uuid de4a6090-4a17-4d48-806a-1fbfb8556e47 {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:34:33.971764 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-3f4017ec-4922-4154-a3eb-223b577124e2 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "DELETE /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47/os-volume_attachments/2a0a6af8-8f14-4b17-af23-cfe0b604e9c4" status: 202 len: 0 microversion: 2.1 time: 0.167149 Sep 26 05:34:33.972386 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 346/670] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 05:34:33 2022] DELETE /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47/os-volume_attachments/2a0a6af8-8f14-4b17-af23-cfe0b604e9c4 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:34:34.291284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-deff2987-54a2-4266-8be4-302f297e5fa0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2107929349", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-641338499", "security_groups": [{"name": "tempest-secgroup-smoke-1686962999"}], "block_device_mapping_v2": [{"uuid": "c24b125c-1700-4425-80c5-c2bcaf23b807", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa57f4f4-2276-4970-8337-66a125f8a06a"}]}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:34.404186 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-deff2987-54a2-4266-8be4-302f297e5fa0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] validate_networks() for [('aa57f4f4-2276-4970-8337-66a125f8a06a', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:34:34.820183 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-deff2987-54a2-4266-8be4-302f297e5fa0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:34:34.820619 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-deff2987-54a2-4266-8be4-302f297e5fa0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:34:34.821087 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-deff2987-54a2-4266-8be4-302f297e5fa0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:34:34.821516 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-deff2987-54a2-4266-8be4-302f297e5fa0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:34:34.821920 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-deff2987-54a2-4266-8be4-302f297e5fa0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:34:34.830554 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-deff2987-54a2-4266-8be4-302f297e5fa0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:34.831026 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-deff2987-54a2-4266-8be4-302f297e5fa0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:34.831451 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-deff2987-54a2-4266-8be4-302f297e5fa0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:34.832161 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-deff2987-54a2-4266-8be4-302f297e5fa0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:34.832768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-deff2987-54a2-4266-8be4-302f297e5fa0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:34.833189 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-deff2987-54a2-4266-8be4-302f297e5fa0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:34.850362 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-deff2987-54a2-4266-8be4-302f297e5fa0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Getting quotas for project 774c63ee5fc74c619f63c64590c154e4. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:34:34.855435 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-deff2987-54a2-4266-8be4-302f297e5fa0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Getting quotas for user 57daecc890ac421b8eb7b5fb4bf25411 and project 774c63ee5fc74c619f63c64590c154e4. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:34:34.911591 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-deff2987-54a2-4266-8be4-302f297e5fa0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:34:34.914374 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-deff2987-54a2-4266-8be4-302f297e5fa0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c24b125c-1700-4425-80c5-c2bcaf23b807',volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:34:35.052215 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-deff2987-54a2-4266-8be4-302f297e5fa0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.765933 Sep 26 05:34:35.059220 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 325/671] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:34:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:34:35.065271 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-30e56f14-6f1e-443b-98d4-70af86c1d700 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:35.065976 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-30e56f14-6f1e-443b-98d4-70af86c1d700 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:35.112763 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2b714028-95ec-497f-8a2e-25830fcd83b0 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:35.119515 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b714028-95ec-497f-8a2e-25830fcd83b0 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:35.120027 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b714028-95ec-497f-8a2e-25830fcd83b0 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:35.120499 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b714028-95ec-497f-8a2e-25830fcd83b0 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:35.126840 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-30e56f14-6f1e-443b-98d4-70af86c1d700 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:35.134106 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-30e56f14-6f1e-443b-98d4-70af86c1d700 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1094 microversion: 2.1 time: 0.073532 Sep 26 05:34:35.135364 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 347/672] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:35 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:35.183262 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2b714028-95ec-497f-8a2e-25830fcd83b0 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Going to try to stop instance {{(pid=120805) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 26 05:34:35.234586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2b714028-95ec-497f-8a2e-25830fcd83b0 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "POST /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47/action" status: 202 len: 0 microversion: 2.1 time: 0.125275 Sep 26 05:34:35.235401 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 326/673] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 05:34:35 2022] POST /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:34:35.244789 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-0c439343-563d-4f39-802c-ec149a066716 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:35.245399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-0c439343-563d-4f39-802c-ec149a066716 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:35.255746 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c439343-563d-4f39-802c-ec149a066716 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:35.255746 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c439343-563d-4f39-802c-ec149a066716 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:35.256178 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c439343-563d-4f39-802c-ec149a066716 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:35.257008 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c439343-563d-4f39-802c-ec149a066716 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:35.257918 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c439343-563d-4f39-802c-ec149a066716 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:35.258349 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c439343-563d-4f39-802c-ec149a066716 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:35.387321 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0c439343-563d-4f39-802c-ec149a066716 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:35.396608 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-0c439343-563d-4f39-802c-ec149a066716 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1678 microversion: 2.1 time: 0.156107 Sep 26 05:34:35.397187 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 348/674] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:35 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:36.158850 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b45428bd-fd11-4803-ac2f-45898b0cfabc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:36.159546 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b45428bd-fd11-4803-ac2f-45898b0cfabc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:36.165833 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b45428bd-fd11-4803-ac2f-45898b0cfabc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:36.166315 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b45428bd-fd11-4803-ac2f-45898b0cfabc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:36.166746 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b45428bd-fd11-4803-ac2f-45898b0cfabc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:36.167424 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b45428bd-fd11-4803-ac2f-45898b0cfabc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:36.167876 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b45428bd-fd11-4803-ac2f-45898b0cfabc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:36.168321 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b45428bd-fd11-4803-ac2f-45898b0cfabc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:36.228955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b45428bd-fd11-4803-ac2f-45898b0cfabc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:36.236542 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b45428bd-fd11-4803-ac2f-45898b0cfabc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1192 microversion: 2.1 time: 0.082415 Sep 26 05:34:36.237102 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 327/675] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:36 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1192 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:36.420828 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-83c3b079-310a-4b65-aceb-226fb98cbdde tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:36.421371 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-83c3b079-310a-4b65-aceb-226fb98cbdde tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:36.423771 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:36.429595 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-83c3b079-310a-4b65-aceb-226fb98cbdde tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:36.430247 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-83c3b079-310a-4b65-aceb-226fb98cbdde tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:36.430686 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-83c3b079-310a-4b65-aceb-226fb98cbdde tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:36.431376 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-83c3b079-310a-4b65-aceb-226fb98cbdde tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:36.431830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-83c3b079-310a-4b65-aceb-226fb98cbdde tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:36.432237 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-83c3b079-310a-4b65-aceb-226fb98cbdde tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:36.583031 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-83c3b079-310a-4b65-aceb-226fb98cbdde tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:36.592591 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-83c3b079-310a-4b65-aceb-226fb98cbdde tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1678 microversion: 2.1 time: 0.175520 Sep 26 05:34:36.593177 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 349/676] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:36 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:37.261226 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-dcc49360-aff1-4f71-b5ff-92ef265c35e3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:37.262033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-dcc49360-aff1-4f71-b5ff-92ef265c35e3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:37.269572 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcc49360-aff1-4f71-b5ff-92ef265c35e3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:37.270408 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcc49360-aff1-4f71-b5ff-92ef265c35e3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:37.271033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcc49360-aff1-4f71-b5ff-92ef265c35e3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:37.272363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcc49360-aff1-4f71-b5ff-92ef265c35e3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:37.273366 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcc49360-aff1-4f71-b5ff-92ef265c35e3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:37.274414 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcc49360-aff1-4f71-b5ff-92ef265c35e3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:37.507758 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-dcc49360-aff1-4f71-b5ff-92ef265c35e3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:37.517399 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-dcc49360-aff1-4f71-b5ff-92ef265c35e3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1278 microversion: 2.1 time: 0.260113 Sep 26 05:34:37.518778 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 328/677] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:37 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1278 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:37.615501 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d5d883fa-015c-4e94-8e65-842482fad63f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:37.616116 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d5d883fa-015c-4e94-8e65-842482fad63f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:37.623363 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d5d883fa-015c-4e94-8e65-842482fad63f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:37.623845 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d5d883fa-015c-4e94-8e65-842482fad63f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:37.624298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d5d883fa-015c-4e94-8e65-842482fad63f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:37.624989 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d5d883fa-015c-4e94-8e65-842482fad63f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:37.625441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d5d883fa-015c-4e94-8e65-842482fad63f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:37.625861 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d5d883fa-015c-4e94-8e65-842482fad63f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:37.832898 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d5d883fa-015c-4e94-8e65-842482fad63f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:37.841458 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d5d883fa-015c-4e94-8e65-842482fad63f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1678 microversion: 2.1 time: 0.229736 Sep 26 05:34:37.856693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 350/678] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:37 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1678 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:38.404274 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-da7b6256-3c48-4a46-9b5b-66ee7ff3a441 req-d4681c75-8ca2-4dbd-a5db-70967e1d8e72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d690507f-f032-475f-b4c4-4f5274841bf9", "tag": "f0547fbd-b0c0-43fb-b376-7a42fb7ce357"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:38.414841 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-da7b6256-3c48-4a46-9b5b-66ee7ff3a441 req-d4681c75-8ca2-4dbd-a5db-70967e1d8e72 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:38.415322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-da7b6256-3c48-4a46-9b5b-66ee7ff3a441 req-d4681c75-8ca2-4dbd-a5db-70967e1d8e72 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:38.415759 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-da7b6256-3c48-4a46-9b5b-66ee7ff3a441 req-d4681c75-8ca2-4dbd-a5db-70967e1d8e72 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:38.426756 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-da7b6256-3c48-4a46-9b5b-66ee7ff3a441 req-d4681c75-8ca2-4dbd-a5db-70967e1d8e72 service nova] Creating event network-changed:f0547fbd-b0c0-43fb-b376-7a42fb7ce357 for instance d690507f-f032-475f-b4c4-4f5274841bf9 on hv-cinder-85918 Sep 26 05:34:38.431758 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-da7b6256-3c48-4a46-9b5b-66ee7ff3a441 req-d4681c75-8ca2-4dbd-a5db-70967e1d8e72 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031499 Sep 26 05:34:38.432399 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 329/679] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:34:38.541898 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-09b3aed5-e495-4172-843c-64f05124e9d3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:38.542524 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-09b3aed5-e495-4172-843c-64f05124e9d3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:38.548528 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-09b3aed5-e495-4172-843c-64f05124e9d3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:38.549016 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-09b3aed5-e495-4172-843c-64f05124e9d3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:38.549454 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-09b3aed5-e495-4172-843c-64f05124e9d3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:38.550142 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-09b3aed5-e495-4172-843c-64f05124e9d3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:38.550598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-09b3aed5-e495-4172-843c-64f05124e9d3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:38.551028 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-09b3aed5-e495-4172-843c-64f05124e9d3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:38.737331 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-09b3aed5-e495-4172-843c-64f05124e9d3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:38.745634 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-09b3aed5-e495-4172-843c-64f05124e9d3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1266 microversion: 2.1 time: 0.207628 Sep 26 05:34:38.746202 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 351/680] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:38 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:38.867528 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d0816a57-94da-499a-9518-cf0412a81147 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:38.868405 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d0816a57-94da-499a-9518-cf0412a81147 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:38.870373 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:38.875635 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0816a57-94da-499a-9518-cf0412a81147 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:38.876122 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0816a57-94da-499a-9518-cf0412a81147 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:38.876584 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0816a57-94da-499a-9518-cf0412a81147 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:38.877273 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0816a57-94da-499a-9518-cf0412a81147 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:38.877726 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0816a57-94da-499a-9518-cf0412a81147 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:38.878197 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0816a57-94da-499a-9518-cf0412a81147 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:39.010276 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d0816a57-94da-499a-9518-cf0412a81147 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:39.018170 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d0816a57-94da-499a-9518-cf0412a81147 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1678 microversion: 2.1 time: 0.155450 Sep 26 05:34:39.018742 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 330/681] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:38 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:39.769419 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-94a0ce19-237d-45f1-814f-b5570e17ccd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:39.770230 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-94a0ce19-237d-45f1-814f-b5570e17ccd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:39.777247 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-94a0ce19-237d-45f1-814f-b5570e17ccd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:39.777735 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-94a0ce19-237d-45f1-814f-b5570e17ccd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:39.778174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-94a0ce19-237d-45f1-814f-b5570e17ccd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:39.778968 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-94a0ce19-237d-45f1-814f-b5570e17ccd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:39.779354 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-94a0ce19-237d-45f1-814f-b5570e17ccd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:39.779775 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-94a0ce19-237d-45f1-814f-b5570e17ccd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:39.787063 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-930c8c1c-f212-4993-a6d9-b83b8d526072 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:39.787990 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-930c8c1c-f212-4993-a6d9-b83b8d526072 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:39.794645 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-930c8c1c-f212-4993-a6d9-b83b8d526072 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:39.795177 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-930c8c1c-f212-4993-a6d9-b83b8d526072 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:39.796194 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-930c8c1c-f212-4993-a6d9-b83b8d526072 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:39.796912 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-930c8c1c-f212-4993-a6d9-b83b8d526072 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:39.797358 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-930c8c1c-f212-4993-a6d9-b83b8d526072 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:39.797970 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-930c8c1c-f212-4993-a6d9-b83b8d526072 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:39.821386 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-930c8c1c-f212-4993-a6d9-b83b8d526072 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lazy-loading 'flavor' on Instance uuid b60837af-4528-4e98-bb46-0e80e3270c0d {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:34:39.895334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-930c8c1c-f212-4993-a6d9-b83b8d526072 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "POST /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d/action" status: 202 len: 0 microversion: 2.1 time: 0.112844 Sep 26 05:34:39.895949 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 331/682] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 05:34:39 2022] POST /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 05:34:39.905442 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-560f1330-7c95-4994-aabd-98d4c6a7e8a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:39.906139 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-560f1330-7c95-4994-aabd-98d4c6a7e8a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:39.912617 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-560f1330-7c95-4994-aabd-98d4c6a7e8a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:39.913108 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-560f1330-7c95-4994-aabd-98d4c6a7e8a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:39.913549 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-560f1330-7c95-4994-aabd-98d4c6a7e8a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:39.916780 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-94a0ce19-237d-45f1-814f-b5570e17ccd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:39.917004 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-560f1330-7c95-4994-aabd-98d4c6a7e8a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:39.917490 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-560f1330-7c95-4994-aabd-98d4c6a7e8a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:39.917931 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-560f1330-7c95-4994-aabd-98d4c6a7e8a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:39.925606 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-94a0ce19-237d-45f1-814f-b5570e17ccd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1266 microversion: 2.1 time: 0.160091 Sep 26 05:34:39.926685 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 352/683] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:39 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:40.041694 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-917545aa-8967-49ea-8648-6a967f11360f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:40.042272 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-917545aa-8967-49ea-8648-6a967f11360f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:40.048233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-917545aa-8967-49ea-8648-6a967f11360f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:40.048749 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-917545aa-8967-49ea-8648-6a967f11360f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:40.049190 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-917545aa-8967-49ea-8648-6a967f11360f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:40.049848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-560f1330-7c95-4994-aabd-98d4c6a7e8a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:40.049985 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-917545aa-8967-49ea-8648-6a967f11360f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:40.050322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-917545aa-8967-49ea-8648-6a967f11360f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:40.050746 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-917545aa-8967-49ea-8648-6a967f11360f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:40.058161 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-560f1330-7c95-4994-aabd-98d4c6a7e8a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.156930 Sep 26 05:34:40.058719 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 332/684] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:39 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:34:40.183359 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-917545aa-8967-49ea-8648-6a967f11360f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:40.191050 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-917545aa-8967-49ea-8648-6a967f11360f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1678 microversion: 2.1 time: 0.153570 Sep 26 05:34:40.191611 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 353/685] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:40 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:34:40.949085 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-35d9961d-55eb-4e3d-894a-b560fb132b9a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:40.949696 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-35d9961d-55eb-4e3d-894a-b560fb132b9a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:40.956139 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-35d9961d-55eb-4e3d-894a-b560fb132b9a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:40.956648 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-35d9961d-55eb-4e3d-894a-b560fb132b9a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:40.957082 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-35d9961d-55eb-4e3d-894a-b560fb132b9a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:40.957756 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-35d9961d-55eb-4e3d-894a-b560fb132b9a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:40.958201 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-35d9961d-55eb-4e3d-894a-b560fb132b9a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:40.958620 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-35d9961d-55eb-4e3d-894a-b560fb132b9a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:41.082717 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-20212efd-48ef-4ea9-bb65-84124ae0d1a5 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:41.083338 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-20212efd-48ef-4ea9-bb65-84124ae0d1a5 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:41.090460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20212efd-48ef-4ea9-bb65-84124ae0d1a5 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:41.091155 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20212efd-48ef-4ea9-bb65-84124ae0d1a5 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:41.091596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20212efd-48ef-4ea9-bb65-84124ae0d1a5 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:41.092395 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20212efd-48ef-4ea9-bb65-84124ae0d1a5 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:41.092863 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20212efd-48ef-4ea9-bb65-84124ae0d1a5 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:41.093330 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20212efd-48ef-4ea9-bb65-84124ae0d1a5 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:41.093432 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-35d9961d-55eb-4e3d-894a-b560fb132b9a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:41.102170 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-35d9961d-55eb-4e3d-894a-b560fb132b9a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1266 microversion: 2.1 time: 0.156768 Sep 26 05:34:41.103043 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 333/686] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:40 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:41.216785 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ebe0518a-13cd-4186-8a4d-60905aec741f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:41.217430 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ebe0518a-13cd-4186-8a4d-60905aec741f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:41.222069 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-20212efd-48ef-4ea9-bb65-84124ae0d1a5 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:41.223335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ebe0518a-13cd-4186-8a4d-60905aec741f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:41.223825 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ebe0518a-13cd-4186-8a4d-60905aec741f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:41.224291 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ebe0518a-13cd-4186-8a4d-60905aec741f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:41.224990 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ebe0518a-13cd-4186-8a4d-60905aec741f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:41.225447 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ebe0518a-13cd-4186-8a4d-60905aec741f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:41.225864 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ebe0518a-13cd-4186-8a4d-60905aec741f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:41.230266 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-20212efd-48ef-4ea9-bb65-84124ae0d1a5 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.151401 Sep 26 05:34:41.230937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 354/687] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:41 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:34:41.359187 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ebe0518a-13cd-4186-8a4d-60905aec741f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:41.367010 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ebe0518a-13cd-4186-8a4d-60905aec741f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1678 microversion: 2.1 time: 0.153986 Sep 26 05:34:41.367574 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 334/688] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:41 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:34:42.125195 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-755dc5f8-0f4e-4b77-b327-15bbb8119fbe tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:42.125829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-755dc5f8-0f4e-4b77-b327-15bbb8119fbe tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:42.132701 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-755dc5f8-0f4e-4b77-b327-15bbb8119fbe tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:42.133176 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-755dc5f8-0f4e-4b77-b327-15bbb8119fbe tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:42.133606 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-755dc5f8-0f4e-4b77-b327-15bbb8119fbe tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:42.134282 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-755dc5f8-0f4e-4b77-b327-15bbb8119fbe tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:42.134729 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-755dc5f8-0f4e-4b77-b327-15bbb8119fbe tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:42.135147 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-755dc5f8-0f4e-4b77-b327-15bbb8119fbe tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:42.254240 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b7d7a0af-05ed-416a-918c-1ffd4411254d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:42.254960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b7d7a0af-05ed-416a-918c-1ffd4411254d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:42.262180 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7d7a0af-05ed-416a-918c-1ffd4411254d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:42.262666 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7d7a0af-05ed-416a-918c-1ffd4411254d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:42.263102 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7d7a0af-05ed-416a-918c-1ffd4411254d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:42.263790 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7d7a0af-05ed-416a-918c-1ffd4411254d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:42.264239 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7d7a0af-05ed-416a-918c-1ffd4411254d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:42.264682 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7d7a0af-05ed-416a-918c-1ffd4411254d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:42.267438 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:42.272051 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-755dc5f8-0f4e-4b77-b327-15bbb8119fbe tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:42.281790 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-755dc5f8-0f4e-4b77-b327-15bbb8119fbe tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1266 microversion: 2.1 time: 0.160362 Sep 26 05:34:42.282520 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 355/689] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:42 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:42.390023 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-4cfdccc8-6824-43d5-83f0-ccdd4584d08b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:42.390641 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-4cfdccc8-6824-43d5-83f0-ccdd4584d08b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:42.396173 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b7d7a0af-05ed-416a-918c-1ffd4411254d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:42.396587 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4cfdccc8-6824-43d5-83f0-ccdd4584d08b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:42.397078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4cfdccc8-6824-43d5-83f0-ccdd4584d08b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:42.397637 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4cfdccc8-6824-43d5-83f0-ccdd4584d08b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:42.398346 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4cfdccc8-6824-43d5-83f0-ccdd4584d08b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:42.398811 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4cfdccc8-6824-43d5-83f0-ccdd4584d08b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:42.399247 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4cfdccc8-6824-43d5-83f0-ccdd4584d08b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:42.404210 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b7d7a0af-05ed-416a-918c-1ffd4411254d tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.153948 Sep 26 05:34:42.404802 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 335/690] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:42 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:34:42.527567 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-4cfdccc8-6824-43d5-83f0-ccdd4584d08b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:42.531013 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:42.536376 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-4cfdccc8-6824-43d5-83f0-ccdd4584d08b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1678 microversion: 2.1 time: 0.150278 Sep 26 05:34:42.536943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 356/691] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:42 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:34:43.305599 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-edd5938c-0e4e-4c5e-a781-407ad6d37ce1 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:43.306216 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-edd5938c-0e4e-4c5e-a781-407ad6d37ce1 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:43.312603 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-edd5938c-0e4e-4c5e-a781-407ad6d37ce1 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:43.313089 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-edd5938c-0e4e-4c5e-a781-407ad6d37ce1 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:43.313528 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-edd5938c-0e4e-4c5e-a781-407ad6d37ce1 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:43.314214 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-edd5938c-0e4e-4c5e-a781-407ad6d37ce1 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:43.314670 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-edd5938c-0e4e-4c5e-a781-407ad6d37ce1 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:43.315094 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-edd5938c-0e4e-4c5e-a781-407ad6d37ce1 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:43.427037 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e0a670be-fcee-4297-b3b4-078abd78fded tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:43.427714 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e0a670be-fcee-4297-b3b4-078abd78fded tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:43.435455 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e0a670be-fcee-4297-b3b4-078abd78fded tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:43.435939 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e0a670be-fcee-4297-b3b4-078abd78fded tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:43.436390 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e0a670be-fcee-4297-b3b4-078abd78fded tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:43.437087 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e0a670be-fcee-4297-b3b4-078abd78fded tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:43.437535 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e0a670be-fcee-4297-b3b4-078abd78fded tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:43.437954 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e0a670be-fcee-4297-b3b4-078abd78fded tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:43.443371 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-edd5938c-0e4e-4c5e-a781-407ad6d37ce1 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:43.451517 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-edd5938c-0e4e-4c5e-a781-407ad6d37ce1 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1266 microversion: 2.1 time: 0.150118 Sep 26 05:34:43.452079 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 336/692] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:43 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:43.559941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e4397957-8040-4468-9c64-534001a8de6b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:43.560470 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e4397957-8040-4468-9c64-534001a8de6b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:43.566401 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e4397957-8040-4468-9c64-534001a8de6b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:43.566896 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e4397957-8040-4468-9c64-534001a8de6b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:43.567336 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e4397957-8040-4468-9c64-534001a8de6b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:43.568030 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e4397957-8040-4468-9c64-534001a8de6b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:43.568512 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e4397957-8040-4468-9c64-534001a8de6b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:43.568944 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e4397957-8040-4468-9c64-534001a8de6b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:43.574892 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e0a670be-fcee-4297-b3b4-078abd78fded tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:43.582570 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e0a670be-fcee-4297-b3b4-078abd78fded tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.159765 Sep 26 05:34:43.583250 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 357/693] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:43 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:34:43.588565 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-143530d1-3084-4b37-aa52-eb6f47a570ad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:43.589254 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-143530d1-3084-4b37-aa52-eb6f47a570ad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:43.594407 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e4397957-8040-4468-9c64-534001a8de6b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2/ips" status: 200 len: 150 microversion: 2.1 time: 0.141223 Sep 26 05:34:43.594958 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-143530d1-3084-4b37-aa52-eb6f47a570ad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:43.595095 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 337/694] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 05:34:43 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2/ips => generated 150 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:34:43.595759 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-143530d1-3084-4b37-aa52-eb6f47a570ad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:43.596281 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-143530d1-3084-4b37-aa52-eb6f47a570ad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:43.597066 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-143530d1-3084-4b37-aa52-eb6f47a570ad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:43.597591 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-143530d1-3084-4b37-aa52-eb6f47a570ad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:43.598084 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-143530d1-3084-4b37-aa52-eb6f47a570ad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:43.729763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-143530d1-3084-4b37-aa52-eb6f47a570ad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:43.737940 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-143530d1-3084-4b37-aa52-eb6f47a570ad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1678 microversion: 2.1 time: 0.153509 Sep 26 05:34:43.738513 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 358/695] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:43 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:44.477717 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8bb5dee7-bfb7-490a-ba76-6cae3c1c0fdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:44.478352 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8bb5dee7-bfb7-490a-ba76-6cae3c1c0fdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:44.484759 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8bb5dee7-bfb7-490a-ba76-6cae3c1c0fdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:44.485233 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8bb5dee7-bfb7-490a-ba76-6cae3c1c0fdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:44.485660 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8bb5dee7-bfb7-490a-ba76-6cae3c1c0fdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:44.486338 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8bb5dee7-bfb7-490a-ba76-6cae3c1c0fdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:44.486784 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8bb5dee7-bfb7-490a-ba76-6cae3c1c0fdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:44.487210 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8bb5dee7-bfb7-490a-ba76-6cae3c1c0fdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:44.607782 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5afd8f00-f725-425b-885b-35fbb7eedb5a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:44.608433 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5afd8f00-f725-425b-885b-35fbb7eedb5a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:44.614901 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5afd8f00-f725-425b-885b-35fbb7eedb5a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:44.615384 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5afd8f00-f725-425b-885b-35fbb7eedb5a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:44.615814 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5afd8f00-f725-425b-885b-35fbb7eedb5a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:44.616699 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5afd8f00-f725-425b-885b-35fbb7eedb5a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:44.617149 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5afd8f00-f725-425b-885b-35fbb7eedb5a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:44.617564 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5afd8f00-f725-425b-885b-35fbb7eedb5a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:44.619460 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8bb5dee7-bfb7-490a-ba76-6cae3c1c0fdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:44.627312 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8bb5dee7-bfb7-490a-ba76-6cae3c1c0fdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1266 microversion: 2.1 time: 0.154498 Sep 26 05:34:44.627879 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 338/696] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:44 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:44.746876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5afd8f00-f725-425b-885b-35fbb7eedb5a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:44.754636 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5afd8f00-f725-425b-885b-35fbb7eedb5a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.150645 Sep 26 05:34:44.755187 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 359/697] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:44 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:34:44.761809 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-11d5eb1d-0237-45c6-982a-ddd8a364b53e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:44.762417 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-11d5eb1d-0237-45c6-982a-ddd8a364b53e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:44.768508 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-11d5eb1d-0237-45c6-982a-ddd8a364b53e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:44.768992 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-11d5eb1d-0237-45c6-982a-ddd8a364b53e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:44.769441 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-11d5eb1d-0237-45c6-982a-ddd8a364b53e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:44.770116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-11d5eb1d-0237-45c6-982a-ddd8a364b53e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:44.770558 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-11d5eb1d-0237-45c6-982a-ddd8a364b53e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:44.770972 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-11d5eb1d-0237-45c6-982a-ddd8a364b53e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:44.840969 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:44.861716 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=6 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:44.899343 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-11d5eb1d-0237-45c6-982a-ddd8a364b53e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:44.907029 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-11d5eb1d-0237-45c6-982a-ddd8a364b53e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1678 microversion: 2.1 time: 0.149163 Sep 26 05:34:44.907584 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 339/698] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:44 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:44.941517 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e03821ea-d42a-4039-b34d-0418f314d18f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd4c1d9a-48b9-46fb-abeb-227d17bc08df"}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:44.943948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e03821ea-d42a-4039-b34d-0418f314d18f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:44.950549 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e03821ea-d42a-4039-b34d-0418f314d18f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:44.951031 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e03821ea-d42a-4039-b34d-0418f314d18f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:44.951475 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e03821ea-d42a-4039-b34d-0418f314d18f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:44.952165 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e03821ea-d42a-4039-b34d-0418f314d18f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:44.952655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e03821ea-d42a-4039-b34d-0418f314d18f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:44.953090 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e03821ea-d42a-4039-b34d-0418f314d18f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:45.131458 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:45.650076 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5c8666c5-761c-4430-98cf-816a4f6d21a0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:45.650684 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5c8666c5-761c-4430-98cf-816a4f6d21a0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:45.657142 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5c8666c5-761c-4430-98cf-816a4f6d21a0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:45.657624 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5c8666c5-761c-4430-98cf-816a4f6d21a0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:45.658063 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5c8666c5-761c-4430-98cf-816a4f6d21a0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:45.658751 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5c8666c5-761c-4430-98cf-816a4f6d21a0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:45.659201 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5c8666c5-761c-4430-98cf-816a4f6d21a0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:45.659626 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5c8666c5-761c-4430-98cf-816a4f6d21a0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:45.807648 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5c8666c5-761c-4430-98cf-816a4f6d21a0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:45.815640 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5c8666c5-761c-4430-98cf-816a4f6d21a0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1266 microversion: 2.1 time: 0.169416 Sep 26 05:34:45.816213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 340/699] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:45 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:34:45.821569 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-22b2278c-d3d7-409b-9f0e-4a1368f82439 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:45.822190 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-22b2278c-d3d7-409b-9f0e-4a1368f82439 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:45.827916 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22b2278c-d3d7-409b-9f0e-4a1368f82439 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:45.828511 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22b2278c-d3d7-409b-9f0e-4a1368f82439 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:45.828991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22b2278c-d3d7-409b-9f0e-4a1368f82439 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:45.829875 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22b2278c-d3d7-409b-9f0e-4a1368f82439 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:45.830337 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22b2278c-d3d7-409b-9f0e-4a1368f82439 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:45.830765 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22b2278c-d3d7-409b-9f0e-4a1368f82439 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:45.907582 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e03821ea-d42a-4039-b34d-0418f314d18f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "POST /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.969912 Sep 26 05:34:45.908443 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 360/700] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 05:34:44 2022] POST /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2/os-volume_attachments => generated 194 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:34:45.933746 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-040fb33b-5ad2-427f-9c80-38c45012b56e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:45.934467 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-040fb33b-5ad2-427f-9c80-38c45012b56e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:45.941332 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-040fb33b-5ad2-427f-9c80-38c45012b56e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:45.941823 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-040fb33b-5ad2-427f-9c80-38c45012b56e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:45.942258 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-040fb33b-5ad2-427f-9c80-38c45012b56e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:45.942957 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-040fb33b-5ad2-427f-9c80-38c45012b56e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:45.943411 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-040fb33b-5ad2-427f-9c80-38c45012b56e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:45.943834 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-040fb33b-5ad2-427f-9c80-38c45012b56e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:45.997414 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-22b2278c-d3d7-409b-9f0e-4a1368f82439 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:46.005636 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-22b2278c-d3d7-409b-9f0e-4a1368f82439 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.188434 Sep 26 05:34:46.006569 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 341/701] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:45 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:46.082349 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-040fb33b-5ad2-427f-9c80-38c45012b56e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:46.094062 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-040fb33b-5ad2-427f-9c80-38c45012b56e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1655 microversion: 2.1 time: 0.165987 Sep 26 05:34:46.094642 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 361/702] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:45 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1655 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:46.117410 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6538a832-6811-4934-b282-28c2dc933fbf tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:46.123631 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6538a832-6811-4934-b282-28c2dc933fbf tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:46.124121 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6538a832-6811-4934-b282-28c2dc933fbf tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:46.124562 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6538a832-6811-4934-b282-28c2dc933fbf tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:46.146589 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6538a832-6811-4934-b282-28c2dc933fbf tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Going to try to start instance {{(pid=120805) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 26 05:34:46.185762 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6538a832-6811-4934-b282-28c2dc933fbf tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "POST /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47/action" status: 202 len: 0 microversion: 2.1 time: 0.072194 Sep 26 05:34:46.186356 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 342/703] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 05:34:46 2022] POST /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:34:46.194372 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-539240b1-48da-4b0c-8082-67249ab7fc40 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:46.195138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-539240b1-48da-4b0c-8082-67249ab7fc40 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:46.201251 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-539240b1-48da-4b0c-8082-67249ab7fc40 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:46.201934 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-539240b1-48da-4b0c-8082-67249ab7fc40 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:46.202530 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-539240b1-48da-4b0c-8082-67249ab7fc40 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:46.203439 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-539240b1-48da-4b0c-8082-67249ab7fc40 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:46.203896 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-539240b1-48da-4b0c-8082-67249ab7fc40 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:46.204349 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-539240b1-48da-4b0c-8082-67249ab7fc40 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:46.367604 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-539240b1-48da-4b0c-8082-67249ab7fc40 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:46.375815 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-539240b1-48da-4b0c-8082-67249ab7fc40 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1664 microversion: 2.1 time: 0.185202 Sep 26 05:34:46.376410 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 362/704] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:46 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1664 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:46.840608 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-700b35a9-0e17-4828-8948-e8c9445e44d2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:46.841327 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-700b35a9-0e17-4828-8948-e8c9445e44d2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:46.847928 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-700b35a9-0e17-4828-8948-e8c9445e44d2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:46.848447 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-700b35a9-0e17-4828-8948-e8c9445e44d2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:46.848884 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-700b35a9-0e17-4828-8948-e8c9445e44d2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:46.849571 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-700b35a9-0e17-4828-8948-e8c9445e44d2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:46.850017 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-700b35a9-0e17-4828-8948-e8c9445e44d2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:46.851002 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-700b35a9-0e17-4828-8948-e8c9445e44d2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:46.989382 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-700b35a9-0e17-4828-8948-e8c9445e44d2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:46.997360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-700b35a9-0e17-4828-8948-e8c9445e44d2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1266 microversion: 2.1 time: 0.161551 Sep 26 05:34:46.997929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 343/705] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:46 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:47.029241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c8eb2ac9-3fbb-4ee2-be64-7fb502b10955 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:47.029856 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c8eb2ac9-3fbb-4ee2-be64-7fb502b10955 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:47.036365 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c8eb2ac9-3fbb-4ee2-be64-7fb502b10955 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:47.036845 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c8eb2ac9-3fbb-4ee2-be64-7fb502b10955 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:47.037275 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c8eb2ac9-3fbb-4ee2-be64-7fb502b10955 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:47.038603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c8eb2ac9-3fbb-4ee2-be64-7fb502b10955 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:47.039174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c8eb2ac9-3fbb-4ee2-be64-7fb502b10955 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:47.039604 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c8eb2ac9-3fbb-4ee2-be64-7fb502b10955 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:47.167519 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-c8eb2ac9-3fbb-4ee2-be64-7fb502b10955 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:47.175137 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c8eb2ac9-3fbb-4ee2-be64-7fb502b10955 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.149724 Sep 26 05:34:47.175701 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 363/706] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:47 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:47.399778 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ae5aaa6c-0e84-432f-bb2e-985f9426fcb1 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:47.400509 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ae5aaa6c-0e84-432f-bb2e-985f9426fcb1 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:47.406651 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ae5aaa6c-0e84-432f-bb2e-985f9426fcb1 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:47.407129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ae5aaa6c-0e84-432f-bb2e-985f9426fcb1 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:47.407564 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ae5aaa6c-0e84-432f-bb2e-985f9426fcb1 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:47.408269 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ae5aaa6c-0e84-432f-bb2e-985f9426fcb1 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:47.408724 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ae5aaa6c-0e84-432f-bb2e-985f9426fcb1 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:47.409148 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ae5aaa6c-0e84-432f-bb2e-985f9426fcb1 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:47.540728 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ae5aaa6c-0e84-432f-bb2e-985f9426fcb1 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:47.548449 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ae5aaa6c-0e84-432f-bb2e-985f9426fcb1 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1664 microversion: 2.1 time: 0.153433 Sep 26 05:34:47.549000 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 344/707] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:47 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:48.020168 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-de3fd876-bd93-4a8d-b0ab-0af864b25298 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:48.020860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-de3fd876-bd93-4a8d-b0ab-0af864b25298 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:48.026892 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de3fd876-bd93-4a8d-b0ab-0af864b25298 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:48.027382 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de3fd876-bd93-4a8d-b0ab-0af864b25298 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:48.027820 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de3fd876-bd93-4a8d-b0ab-0af864b25298 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:48.028542 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de3fd876-bd93-4a8d-b0ab-0af864b25298 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:48.029002 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de3fd876-bd93-4a8d-b0ab-0af864b25298 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:48.029430 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de3fd876-bd93-4a8d-b0ab-0af864b25298 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:48.183794 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-de3fd876-bd93-4a8d-b0ab-0af864b25298 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:48.191616 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-de3fd876-bd93-4a8d-b0ab-0af864b25298 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1266 microversion: 2.1 time: 0.175376 Sep 26 05:34:48.192187 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 364/708] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:48 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:48.199036 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-784ea6ca-b96c-4691-b94d-35d2bc151a07 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:48.199653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-784ea6ca-b96c-4691-b94d-35d2bc151a07 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:48.205982 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-784ea6ca-b96c-4691-b94d-35d2bc151a07 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:48.206464 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-784ea6ca-b96c-4691-b94d-35d2bc151a07 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:48.206898 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-784ea6ca-b96c-4691-b94d-35d2bc151a07 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:48.207586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-784ea6ca-b96c-4691-b94d-35d2bc151a07 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:48.208037 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-784ea6ca-b96c-4691-b94d-35d2bc151a07 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:48.208495 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-784ea6ca-b96c-4691-b94d-35d2bc151a07 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:48.338933 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-784ea6ca-b96c-4691-b94d-35d2bc151a07 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:48.346656 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-784ea6ca-b96c-4691-b94d-35d2bc151a07 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.151799 Sep 26 05:34:48.347212 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 345/709] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:48 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:48.572008 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1cf38067-945d-4079-a8e0-bb2641297664 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:48.572759 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-1cf38067-945d-4079-a8e0-bb2641297664 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:48.578547 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1cf38067-945d-4079-a8e0-bb2641297664 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:48.579055 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1cf38067-945d-4079-a8e0-bb2641297664 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:48.579486 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1cf38067-945d-4079-a8e0-bb2641297664 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:48.580170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1cf38067-945d-4079-a8e0-bb2641297664 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:48.580645 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1cf38067-945d-4079-a8e0-bb2641297664 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:48.581062 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1cf38067-945d-4079-a8e0-bb2641297664 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:48.712955 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1cf38067-945d-4079-a8e0-bb2641297664 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:48.720821 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1cf38067-945d-4079-a8e0-bb2641297664 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1668 microversion: 2.1 time: 0.152647 Sep 26 05:34:48.721381 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 365/710] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:48 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:34:49.214593 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-66423986-4a8d-45e4-91a1-4254c8741f9c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:49.215203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-66423986-4a8d-45e4-91a1-4254c8741f9c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:49.221546 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66423986-4a8d-45e4-91a1-4254c8741f9c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:49.222026 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66423986-4a8d-45e4-91a1-4254c8741f9c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:49.222454 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66423986-4a8d-45e4-91a1-4254c8741f9c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:49.223122 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66423986-4a8d-45e4-91a1-4254c8741f9c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:49.223566 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66423986-4a8d-45e4-91a1-4254c8741f9c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:49.224117 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66423986-4a8d-45e4-91a1-4254c8741f9c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:49.352442 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-66423986-4a8d-45e4-91a1-4254c8741f9c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:49.360013 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-66423986-4a8d-45e4-91a1-4254c8741f9c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1266 microversion: 2.1 time: 0.149254 Sep 26 05:34:49.360655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 346/711] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:49 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:49.371546 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6be41d0b-1f78-4536-8a7d-6323258cfea4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:49.372166 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6be41d0b-1f78-4536-8a7d-6323258cfea4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:49.378540 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6be41d0b-1f78-4536-8a7d-6323258cfea4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:49.379020 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6be41d0b-1f78-4536-8a7d-6323258cfea4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:49.379454 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6be41d0b-1f78-4536-8a7d-6323258cfea4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:49.380140 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6be41d0b-1f78-4536-8a7d-6323258cfea4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:49.380652 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6be41d0b-1f78-4536-8a7d-6323258cfea4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:49.381078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6be41d0b-1f78-4536-8a7d-6323258cfea4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:49.509827 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6be41d0b-1f78-4536-8a7d-6323258cfea4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:49.517536 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6be41d0b-1f78-4536-8a7d-6323258cfea4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.149877 Sep 26 05:34:49.518106 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 366/712] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:49 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:50.049357 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-1a0d30c8-48a8-48e8-8404-2c8c9599697b req-972c9595-a310-4514-b460-44c410d4dc9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d690507f-f032-475f-b4c4-4f5274841bf9", "name": "network-vif-plugged", "status": "completed", "tag": "f0547fbd-b0c0-43fb-b376-7a42fb7ce357"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:50.061085 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-1a0d30c8-48a8-48e8-8404-2c8c9599697b req-972c9595-a310-4514-b460-44c410d4dc9c service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:50.061566 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-1a0d30c8-48a8-48e8-8404-2c8c9599697b req-972c9595-a310-4514-b460-44c410d4dc9c service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:50.062172 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-1a0d30c8-48a8-48e8-8404-2c8c9599697b req-972c9595-a310-4514-b460-44c410d4dc9c service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:50.073268 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-1a0d30c8-48a8-48e8-8404-2c8c9599697b req-972c9595-a310-4514-b460-44c410d4dc9c service nova] Creating event network-vif-plugged:f0547fbd-b0c0-43fb-b376-7a42fb7ce357 for instance d690507f-f032-475f-b4c4-4f5274841bf9 on hv-cinder-85918 Sep 26 05:34:50.078146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-1a0d30c8-48a8-48e8-8404-2c8c9599697b req-972c9595-a310-4514-b460-44c410d4dc9c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032784 Sep 26 05:34:50.078903 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 347/713] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:34:50.383610 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5476741c-0052-4480-ad18-f60105f166ac tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:50.384229 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5476741c-0052-4480-ad18-f60105f166ac tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:50.390752 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5476741c-0052-4480-ad18-f60105f166ac tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:50.391177 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5476741c-0052-4480-ad18-f60105f166ac tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:50.391611 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5476741c-0052-4480-ad18-f60105f166ac tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:50.392329 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5476741c-0052-4480-ad18-f60105f166ac tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:50.392782 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5476741c-0052-4480-ad18-f60105f166ac tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:50.393206 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5476741c-0052-4480-ad18-f60105f166ac tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:50.540936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fbef4667-14b1-45f4-bb4e-d4f0da4b7762 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:50.541634 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fbef4667-14b1-45f4-bb4e-d4f0da4b7762 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:50.542377 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5476741c-0052-4480-ad18-f60105f166ac tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:50.548190 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fbef4667-14b1-45f4-bb4e-d4f0da4b7762 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:50.548699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fbef4667-14b1-45f4-bb4e-d4f0da4b7762 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:50.550204 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5476741c-0052-4480-ad18-f60105f166ac tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1266 microversion: 2.1 time: 0.171103 Sep 26 05:34:50.550777 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 367/714] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:50 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:50.553894 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fbef4667-14b1-45f4-bb4e-d4f0da4b7762 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:50.554622 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fbef4667-14b1-45f4-bb4e-d4f0da4b7762 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:50.555078 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fbef4667-14b1-45f4-bb4e-d4f0da4b7762 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:50.555500 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fbef4667-14b1-45f4-bb4e-d4f0da4b7762 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:50.693726 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fbef4667-14b1-45f4-bb4e-d4f0da4b7762 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:50.701423 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fbef4667-14b1-45f4-bb4e-d4f0da4b7762 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.165220 Sep 26 05:34:50.701982 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 348/715] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:50 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:34:51.574800 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-92ef0b72-69fe-4c92-9762-a664ef0069e8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:51.575665 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-92ef0b72-69fe-4c92-9762-a664ef0069e8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:51.585668 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92ef0b72-69fe-4c92-9762-a664ef0069e8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:51.586161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92ef0b72-69fe-4c92-9762-a664ef0069e8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:51.586594 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92ef0b72-69fe-4c92-9762-a664ef0069e8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:51.587282 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92ef0b72-69fe-4c92-9762-a664ef0069e8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:51.587729 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92ef0b72-69fe-4c92-9762-a664ef0069e8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:51.588143 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92ef0b72-69fe-4c92-9762-a664ef0069e8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:51.725164 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3fd11f0b-7fb8-421e-afc8-d59bafeaefdb tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:51.725961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3fd11f0b-7fb8-421e-afc8-d59bafeaefdb tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:51.733074 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-92ef0b72-69fe-4c92-9762-a664ef0069e8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:51.733878 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3fd11f0b-7fb8-421e-afc8-d59bafeaefdb tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:51.734440 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3fd11f0b-7fb8-421e-afc8-d59bafeaefdb tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:51.734943 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3fd11f0b-7fb8-421e-afc8-d59bafeaefdb tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:51.735740 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3fd11f0b-7fb8-421e-afc8-d59bafeaefdb tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:51.736282 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3fd11f0b-7fb8-421e-afc8-d59bafeaefdb tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:51.736760 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3fd11f0b-7fb8-421e-afc8-d59bafeaefdb tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:51.744592 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-92ef0b72-69fe-4c92-9762-a664ef0069e8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1266 microversion: 2.1 time: 0.175416 Sep 26 05:34:51.745174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 368/716] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:51 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:51.883580 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3fd11f0b-7fb8-421e-afc8-d59bafeaefdb tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:51.892944 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3fd11f0b-7fb8-421e-afc8-d59bafeaefdb tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.171557 Sep 26 05:34:51.893718 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 349/717] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:51 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:34:52.768785 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-06d6ae3e-01ea-4538-9844-751d4c4a1163 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:52.769401 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-06d6ae3e-01ea-4538-9844-751d4c4a1163 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:52.776671 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-06d6ae3e-01ea-4538-9844-751d4c4a1163 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:52.777151 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-06d6ae3e-01ea-4538-9844-751d4c4a1163 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:52.777580 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-06d6ae3e-01ea-4538-9844-751d4c4a1163 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:52.778261 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-06d6ae3e-01ea-4538-9844-751d4c4a1163 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:52.778708 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-06d6ae3e-01ea-4538-9844-751d4c4a1163 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:52.779123 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-06d6ae3e-01ea-4538-9844-751d4c4a1163 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:52.907112 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-06d6ae3e-01ea-4538-9844-751d4c4a1163 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:52.915093 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-06d6ae3e-01ea-4538-9844-751d4c4a1163 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1453 microversion: 2.1 time: 0.150213 Sep 26 05:34:52.915646 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 369/718] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:52 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:52.918444 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5e82ec76-a89f-4ba3-a134-fbb4b4e8dd00 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:52.919069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5e82ec76-a89f-4ba3-a134-fbb4b4e8dd00 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:52.925577 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e82ec76-a89f-4ba3-a134-fbb4b4e8dd00 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:52.926063 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e82ec76-a89f-4ba3-a134-fbb4b4e8dd00 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:52.926500 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e82ec76-a89f-4ba3-a134-fbb4b4e8dd00 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:52.927185 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e82ec76-a89f-4ba3-a134-fbb4b4e8dd00 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:52.927637 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e82ec76-a89f-4ba3-a134-fbb4b4e8dd00 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:52.928627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e82ec76-a89f-4ba3-a134-fbb4b4e8dd00 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:52.937754 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1da73eeb-858f-4f20-a65f-1c4fc1702a03 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:52.938373 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-1da73eeb-858f-4f20-a65f-1c4fc1702a03 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:52.945120 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1da73eeb-858f-4f20-a65f-1c4fc1702a03 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:52.945597 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1da73eeb-858f-4f20-a65f-1c4fc1702a03 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:52.946045 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1da73eeb-858f-4f20-a65f-1c4fc1702a03 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:52.946750 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1da73eeb-858f-4f20-a65f-1c4fc1702a03 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:52.947206 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1da73eeb-858f-4f20-a65f-1c4fc1702a03 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:52.947637 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1da73eeb-858f-4f20-a65f-1c4fc1702a03 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:53.130251 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5e82ec76-a89f-4ba3-a134-fbb4b4e8dd00 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:53.135236 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1da73eeb-858f-4f20-a65f-1c4fc1702a03 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:53.139158 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5e82ec76-a89f-4ba3-a134-fbb4b4e8dd00 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.224597 Sep 26 05:34:53.139742 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 350/719] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:52 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:34:53.142808 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1da73eeb-858f-4f20-a65f-1c4fc1702a03 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1453 microversion: 2.1 time: 0.208841 Sep 26 05:34:53.143357 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 370/720] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:52 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1453 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:34:54.164114 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-18570615-70fb-4959-a19d-a49a5e5818ad tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:54.165032 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-18570615-70fb-4959-a19d-a49a5e5818ad tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:54.171540 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-18570615-70fb-4959-a19d-a49a5e5818ad tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:54.172108 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-18570615-70fb-4959-a19d-a49a5e5818ad tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:54.172655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-18570615-70fb-4959-a19d-a49a5e5818ad tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:54.173528 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-18570615-70fb-4959-a19d-a49a5e5818ad tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:54.174106 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-18570615-70fb-4959-a19d-a49a5e5818ad tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:54.174655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-18570615-70fb-4959-a19d-a49a5e5818ad tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:54.425808 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-18570615-70fb-4959-a19d-a49a5e5818ad tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:54.428169 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:54.435622 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-18570615-70fb-4959-a19d-a49a5e5818ad tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.276333 Sep 26 05:34:54.448206 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 351/721] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:54 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:54.533862 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-adf6bc0a-3e2d-4579-9ad0-ed3c2dab36e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd4c1d9a-48b9-46fb-abeb-227d17bc08df"}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:54.536562 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-adf6bc0a-3e2d-4579-9ad0-ed3c2dab36e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:54.544129 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-adf6bc0a-3e2d-4579-9ad0-ed3c2dab36e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:54.544686 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-adf6bc0a-3e2d-4579-9ad0-ed3c2dab36e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:54.545116 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-adf6bc0a-3e2d-4579-9ad0-ed3c2dab36e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:54.545811 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-adf6bc0a-3e2d-4579-9ad0-ed3c2dab36e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:54.546259 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-adf6bc0a-3e2d-4579-9ad0-ed3c2dab36e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:54.546675 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-adf6bc0a-3e2d-4579-9ad0-ed3c2dab36e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:54.632932 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-adf6bc0a-3e2d-4579-9ad0-ed3c2dab36e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] HTTP exception thrown: Invalid volume: volume cd4c1d9a-48b9-46fb-abeb-227d17bc08df is already attached to instances: 43405413-d653-4c48-acc8-3af217fb7ea2 Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-adf6bc0a-3e2d-4579-9ad0-ed3c2dab36e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Request method failure captured: Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: POST /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2/os-volume_attachments HTTP/1.1 Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 74 Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTi0HNidMJ_uUjz9W9nG4CLXam9AEEcBUxHuJymFks4FVk8X_UREH6vt6sYWIBIpMYwbfop3-Tu9G5rH-U470tWXr7O7oFa6DqY-WLodQcPeOqi33ywVkGIxoXJu-o6j8RNWX3xYPNIu8TNqBir3Si8HbJUdBskNzCM6QioApbM8lh8 Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:34:54.634921 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:34:54.636486 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd13dd8ec810435491e3f3cba7cca4d1"}]}] Sep 26 05:34:54.636486 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:34:54.636486 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:34:54.636486 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:34:54.636486 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:34:54.636486 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:34:54.636486 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:34:54.636486 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 48e588ff6d5a4a37b902abadfb6d04fc Sep 26 05:34:54.636486 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:34:54.636486 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Sep 26 05:34:54.636486 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {"volumeAttachment": {"volumeId": "cd4c1d9a-48b9-46fb-abeb-227d17bc08df"}} Sep 26 05:34:54.636486 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Invalid volume: volume cd4c1d9a-48b9-46fb-abeb-227d17bc08df is already attached to instances: 43405413-d653-4c48-acc8-3af217fb7ea2 Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'server_id': '43405413-d653-4c48-acc8-3af217fb7ea2', 'body': {'volumeAttachment': {'volumeId': 'cd4c1d9a-48b9-46fb-abeb-227d17bc08df'}}} Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cd4c1d9a-48b9-46fb-abeb-227d17bc08df is already attached to instances: 43405413-d653-4c48-acc8-3af217fb7ea2 Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:34:54.637356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cd4c1d9a-48b9-46fb-abeb-227d17bc08df is already attached to instances: 43405413-d653-4c48-acc8-3af217fb7ea2 Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:34:54.638858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:34:54.640453 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:34:54.640453 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:34:54.640453 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:34:54.640453 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cd4c1d9a-48b9-46fb-abeb-227d17bc08df is already attached to instances: 43405413-d653-4c48-acc8-3af217fb7ea2 Sep 26 05:34:54.640453 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:34:54.640453 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-adf6bc0a-3e2d-4579-9ad0-ed3c2dab36e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Returning 400 to user: Invalid volume: volume cd4c1d9a-48b9-46fb-abeb-227d17bc08df is already attached to instances: 43405413-d653-4c48-acc8-3af217fb7ea2 {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:34:54.640453 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-adf6bc0a-3e2d-4579-9ad0-ed3c2dab36e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "POST /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106692 Sep 26 05:34:54.640453 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 371/722] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 05:34:54 2022] POST /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 05:34:54.706813 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1e677814-18bc-49d3-89f9-1aa405c9d5e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:54.707541 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1e677814-18bc-49d3-89f9-1aa405c9d5e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:54.714613 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e677814-18bc-49d3-89f9-1aa405c9d5e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:54.715103 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e677814-18bc-49d3-89f9-1aa405c9d5e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:54.715547 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e677814-18bc-49d3-89f9-1aa405c9d5e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:54.716274 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e677814-18bc-49d3-89f9-1aa405c9d5e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:54.716731 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e677814-18bc-49d3-89f9-1aa405c9d5e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:54.717153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e677814-18bc-49d3-89f9-1aa405c9d5e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:54.800827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-1e677814-18bc-49d3-89f9-1aa405c9d5e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lazy-loading 'services' on Instance uuid 43405413-d653-4c48-acc8-3af217fb7ea2 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:34:54.876080 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1e677814-18bc-49d3-89f9-1aa405c9d5e0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "DELETE /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2/os-volume_attachments/cd4c1d9a-48b9-46fb-abeb-227d17bc08df" status: 202 len: 0 microversion: 2.1 time: 0.173117 Sep 26 05:34:54.876710 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 352/723] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 05:34:54 2022] DELETE /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2/os-volume_attachments/cd4c1d9a-48b9-46fb-abeb-227d17bc08df => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:34:54.885148 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-744a8c22-0b72-41b0-b67d-35a194bfd501 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:54.887436 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-744a8c22-0b72-41b0-b67d-35a194bfd501 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:54.894407 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-744a8c22-0b72-41b0-b67d-35a194bfd501 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:54.894899 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-744a8c22-0b72-41b0-b67d-35a194bfd501 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:54.895332 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-744a8c22-0b72-41b0-b67d-35a194bfd501 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:54.896022 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-744a8c22-0b72-41b0-b67d-35a194bfd501 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:54.896495 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-744a8c22-0b72-41b0-b67d-35a194bfd501 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:54.897053 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-744a8c22-0b72-41b0-b67d-35a194bfd501 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:54.901348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:54.930839 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-744a8c22-0b72-41b0-b67d-35a194bfd501 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049744 Sep 26 05:34:54.931418 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 372/724] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:34:54 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:34:55.169423 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-d5fb493b-21f0-40d2-9212-9fee8cf2690a req-b76d5ee4-7830-4d91-8c5c-a6dbfafe6bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d690507f-f032-475f-b4c4-4f5274841bf9", "tag": "f0547fbd-b0c0-43fb-b376-7a42fb7ce357"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:34:55.179740 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-d5fb493b-21f0-40d2-9212-9fee8cf2690a req-b76d5ee4-7830-4d91-8c5c-a6dbfafe6bc2 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:55.180214 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-d5fb493b-21f0-40d2-9212-9fee8cf2690a req-b76d5ee4-7830-4d91-8c5c-a6dbfafe6bc2 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:55.180669 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-d5fb493b-21f0-40d2-9212-9fee8cf2690a req-b76d5ee4-7830-4d91-8c5c-a6dbfafe6bc2 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:55.191294 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-d5fb493b-21f0-40d2-9212-9fee8cf2690a req-b76d5ee4-7830-4d91-8c5c-a6dbfafe6bc2 service nova] Creating event network-changed:f0547fbd-b0c0-43fb-b376-7a42fb7ce357 for instance d690507f-f032-475f-b4c4-4f5274841bf9 on hv-cinder-85918 Sep 26 05:34:55.196268 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-d5fb493b-21f0-40d2-9212-9fee8cf2690a req-b76d5ee4-7830-4d91-8c5c-a6dbfafe6bc2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086436 Sep 26 05:34:55.196903 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 353/725] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:34:55.460011 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5f017134-ecb4-4d4d-9551-4584cbe60faf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:55.460762 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5f017134-ecb4-4d4d-9551-4584cbe60faf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:55.466908 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f017134-ecb4-4d4d-9551-4584cbe60faf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:55.467563 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f017134-ecb4-4d4d-9551-4584cbe60faf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:55.468048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f017134-ecb4-4d4d-9551-4584cbe60faf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:55.468742 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f017134-ecb4-4d4d-9551-4584cbe60faf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:55.469196 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f017134-ecb4-4d4d-9551-4584cbe60faf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:55.469658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f017134-ecb4-4d4d-9551-4584cbe60faf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:55.603126 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5f017134-ecb4-4d4d-9551-4584cbe60faf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:55.611249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5f017134-ecb4-4d4d-9551-4584cbe60faf tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.155551 Sep 26 05:34:55.624423 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 373/726] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:55 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:55.944713 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bb647caf-0b32-4260-9cdb-760a4aacae93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:55.947252 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bb647caf-0b32-4260-9cdb-760a4aacae93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:55.956087 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bb647caf-0b32-4260-9cdb-760a4aacae93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:55.956817 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bb647caf-0b32-4260-9cdb-760a4aacae93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:55.957402 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bb647caf-0b32-4260-9cdb-760a4aacae93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:55.958298 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bb647caf-0b32-4260-9cdb-760a4aacae93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:55.959595 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bb647caf-0b32-4260-9cdb-760a4aacae93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:55.960471 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bb647caf-0b32-4260-9cdb-760a4aacae93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:55.996632 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bb647caf-0b32-4260-9cdb-760a4aacae93 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056780 Sep 26 05:34:55.998123 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 354/727] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:34:55 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:34:56.635258 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b29afc96-d5e7-4365-a07a-4c269b92dd58 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:56.635876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b29afc96-d5e7-4365-a07a-4c269b92dd58 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:56.642652 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b29afc96-d5e7-4365-a07a-4c269b92dd58 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:56.643138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b29afc96-d5e7-4365-a07a-4c269b92dd58 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:56.643573 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b29afc96-d5e7-4365-a07a-4c269b92dd58 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:56.644296 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b29afc96-d5e7-4365-a07a-4c269b92dd58 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:56.644760 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b29afc96-d5e7-4365-a07a-4c269b92dd58 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:56.645222 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b29afc96-d5e7-4365-a07a-4c269b92dd58 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:56.774800 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b29afc96-d5e7-4365-a07a-4c269b92dd58 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:56.782511 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b29afc96-d5e7-4365-a07a-4c269b92dd58 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.151107 Sep 26 05:34:56.783074 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 374/728] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:56 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:57.010596 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4f2778fb-0649-4858-9f37-7af538cdcc59 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:57.012789 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4f2778fb-0649-4858-9f37-7af538cdcc59 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:57.019222 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4f2778fb-0649-4858-9f37-7af538cdcc59 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:57.019702 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4f2778fb-0649-4858-9f37-7af538cdcc59 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:57.020133 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4f2778fb-0649-4858-9f37-7af538cdcc59 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:57.020842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4f2778fb-0649-4858-9f37-7af538cdcc59 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:57.021289 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4f2778fb-0649-4858-9f37-7af538cdcc59 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:57.022373 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4f2778fb-0649-4858-9f37-7af538cdcc59 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:57.050231 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4f2778fb-0649-4858-9f37-7af538cdcc59 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044192 Sep 26 05:34:57.050781 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 355/729] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:34:57 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:34:57.114556 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-35b6f765-980a-4b67-9ec8-4c3ffd57ff5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:57.115060 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-35b6f765-980a-4b67-9ec8-4c3ffd57ff5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:57.121403 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-35b6f765-980a-4b67-9ec8-4c3ffd57ff5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:57.121890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-35b6f765-980a-4b67-9ec8-4c3ffd57ff5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:57.122328 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-35b6f765-980a-4b67-9ec8-4c3ffd57ff5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:57.123021 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-35b6f765-980a-4b67-9ec8-4c3ffd57ff5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:57.123478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-35b6f765-980a-4b67-9ec8-4c3ffd57ff5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:57.123906 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-35b6f765-980a-4b67-9ec8-4c3ffd57ff5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:57.150836 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-35b6f765-980a-4b67-9ec8-4c3ffd57ff5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Going to try to terminate instance {{(pid=120806) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:34:57.225590 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-35b6f765-980a-4b67-9ec8-4c3ffd57ff5f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "DELETE /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 204 len: 0 microversion: 2.1 time: 0.114181 Sep 26 05:34:57.226176 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 375/730] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:34:57 2022] DELETE /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:34:57.234445 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-66fdf836-d75d-46aa-8538-e396e811d617 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:57.235096 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-66fdf836-d75d-46aa-8538-e396e811d617 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:57.241094 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66fdf836-d75d-46aa-8538-e396e811d617 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:57.241571 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66fdf836-d75d-46aa-8538-e396e811d617 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:57.242013 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66fdf836-d75d-46aa-8538-e396e811d617 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:57.242698 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66fdf836-d75d-46aa-8538-e396e811d617 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:57.243153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66fdf836-d75d-46aa-8538-e396e811d617 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:57.243576 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66fdf836-d75d-46aa-8538-e396e811d617 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:57.374160 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-66fdf836-d75d-46aa-8538-e396e811d617 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:57.382933 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-66fdf836-d75d-46aa-8538-e396e811d617 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 200 len: 1681 microversion: 2.1 time: 0.152260 Sep 26 05:34:57.383494 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 356/731] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:57 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:57.807709 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-4cb17b0a-92ab-4bbf-91b9-db5938ddbd05 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:57.808581 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-4cb17b0a-92ab-4bbf-91b9-db5938ddbd05 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:57.814901 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4cb17b0a-92ab-4bbf-91b9-db5938ddbd05 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:57.815386 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4cb17b0a-92ab-4bbf-91b9-db5938ddbd05 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:57.815818 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4cb17b0a-92ab-4bbf-91b9-db5938ddbd05 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:57.816523 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4cb17b0a-92ab-4bbf-91b9-db5938ddbd05 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:57.816978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4cb17b0a-92ab-4bbf-91b9-db5938ddbd05 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:57.817403 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4cb17b0a-92ab-4bbf-91b9-db5938ddbd05 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:57.959286 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-4cb17b0a-92ab-4bbf-91b9-db5938ddbd05 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:57.967493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-4cb17b0a-92ab-4bbf-91b9-db5938ddbd05 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.164636 Sep 26 05:34:57.968051 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 376/732] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:57 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:58.407071 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1cbfe2c2-5b41-4de0-a802-c1f5003fd302 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:58.407607 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1cbfe2c2-5b41-4de0-a802-c1f5003fd302 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:58.414649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1cbfe2c2-5b41-4de0-a802-c1f5003fd302 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:58.415108 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1cbfe2c2-5b41-4de0-a802-c1f5003fd302 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:58.415566 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1cbfe2c2-5b41-4de0-a802-c1f5003fd302 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:58.416243 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1cbfe2c2-5b41-4de0-a802-c1f5003fd302 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:58.416709 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1cbfe2c2-5b41-4de0-a802-c1f5003fd302 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:58.417127 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1cbfe2c2-5b41-4de0-a802-c1f5003fd302 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:58.543205 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1cbfe2c2-5b41-4de0-a802-c1f5003fd302 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:58.550944 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1cbfe2c2-5b41-4de0-a802-c1f5003fd302 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 200 len: 1681 microversion: 2.1 time: 0.147850 Sep 26 05:34:58.551505 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 357/733] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:58 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:58.991815 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5f5798f0-8ac5-4193-8cef-a6019e3a142c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:58.992439 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5f5798f0-8ac5-4193-8cef-a6019e3a142c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:58.998879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f5798f0-8ac5-4193-8cef-a6019e3a142c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:58.999360 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f5798f0-8ac5-4193-8cef-a6019e3a142c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:58.999822 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f5798f0-8ac5-4193-8cef-a6019e3a142c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:59.000530 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f5798f0-8ac5-4193-8cef-a6019e3a142c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:59.000991 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f5798f0-8ac5-4193-8cef-a6019e3a142c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:59.001408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f5798f0-8ac5-4193-8cef-a6019e3a142c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:59.134067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5f5798f0-8ac5-4193-8cef-a6019e3a142c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:59.141819 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5f5798f0-8ac5-4193-8cef-a6019e3a142c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.154790 Sep 26 05:34:59.142381 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 377/734] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:58 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:34:59.574491 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-31188870-8c1e-409e-b308-f151c926f995 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:34:59.575100 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-31188870-8c1e-409e-b308-f151c926f995 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:34:59.581514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-31188870-8c1e-409e-b308-f151c926f995 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:59.581988 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-31188870-8c1e-409e-b308-f151c926f995 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:59.582419 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-31188870-8c1e-409e-b308-f151c926f995 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:59.583094 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-31188870-8c1e-409e-b308-f151c926f995 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:34:59.583541 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-31188870-8c1e-409e-b308-f151c926f995 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:34:59.584532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-31188870-8c1e-409e-b308-f151c926f995 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:34:59.710152 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-31188870-8c1e-409e-b308-f151c926f995 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:34:59.717791 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-31188870-8c1e-409e-b308-f151c926f995 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 200 len: 1681 microversion: 2.1 time: 0.147203 Sep 26 05:34:59.718361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 358/735] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:34:59 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:00.165475 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-8809e048-14a1-450e-9eeb-32972c9d27bd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:00.166083 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-8809e048-14a1-450e-9eeb-32972c9d27bd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:00.172536 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8809e048-14a1-450e-9eeb-32972c9d27bd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:00.173014 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8809e048-14a1-450e-9eeb-32972c9d27bd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:00.173439 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8809e048-14a1-450e-9eeb-32972c9d27bd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:00.174110 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8809e048-14a1-450e-9eeb-32972c9d27bd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:00.174552 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8809e048-14a1-450e-9eeb-32972c9d27bd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:00.174967 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8809e048-14a1-450e-9eeb-32972c9d27bd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:00.303057 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8809e048-14a1-450e-9eeb-32972c9d27bd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:00.310734 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-8809e048-14a1-450e-9eeb-32972c9d27bd tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.149233 Sep 26 05:35:00.311295 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 378/736] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:00 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:00.742574 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2539c8a0-b467-4936-9e13-1f8eb333a22a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:00.743309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2539c8a0-b467-4936-9e13-1f8eb333a22a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:00.749861 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2539c8a0-b467-4936-9e13-1f8eb333a22a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:00.750347 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2539c8a0-b467-4936-9e13-1f8eb333a22a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:00.750777 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2539c8a0-b467-4936-9e13-1f8eb333a22a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:00.751462 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2539c8a0-b467-4936-9e13-1f8eb333a22a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:00.751911 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2539c8a0-b467-4936-9e13-1f8eb333a22a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:00.752359 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2539c8a0-b467-4936-9e13-1f8eb333a22a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:00.906700 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2539c8a0-b467-4936-9e13-1f8eb333a22a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:00.915981 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2539c8a0-b467-4936-9e13-1f8eb333a22a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 200 len: 1681 microversion: 2.1 time: 0.177308 Sep 26 05:35:00.916777 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 359/737] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:00 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:01.335096 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-dc6ca975-6fcb-4860-9ac3-4a9e26b2a6d0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:01.335855 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-dc6ca975-6fcb-4860-9ac3-4a9e26b2a6d0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:01.342347 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dc6ca975-6fcb-4860-9ac3-4a9e26b2a6d0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:01.343008 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dc6ca975-6fcb-4860-9ac3-4a9e26b2a6d0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:01.343561 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dc6ca975-6fcb-4860-9ac3-4a9e26b2a6d0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:01.344455 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dc6ca975-6fcb-4860-9ac3-4a9e26b2a6d0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:01.345036 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dc6ca975-6fcb-4860-9ac3-4a9e26b2a6d0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:01.345546 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dc6ca975-6fcb-4860-9ac3-4a9e26b2a6d0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:01.361373 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-fd2be8f6-86a1-42d8-9678-7565271ef071 req-29329b03-c954-4775-8354-1024374f8cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43405413-d653-4c48-acc8-3af217fb7ea2", "name": "network-vif-deleted", "tag": "a1082fba-8ef8-438a-a567-b6ff8339736c"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:35:01.377027 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-fd2be8f6-86a1-42d8-9678-7565271ef071 req-29329b03-c954-4775-8354-1024374f8cd1 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:01.377607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-fd2be8f6-86a1-42d8-9678-7565271ef071 req-29329b03-c954-4775-8354-1024374f8cd1 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:01.378279 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-fd2be8f6-86a1-42d8-9678-7565271ef071 req-29329b03-c954-4775-8354-1024374f8cd1 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:01.391539 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-fd2be8f6-86a1-42d8-9678-7565271ef071 req-29329b03-c954-4775-8354-1024374f8cd1 service nova] Creating event network-vif-deleted:a1082fba-8ef8-438a-a567-b6ff8339736c for instance 43405413-d653-4c48-acc8-3af217fb7ea2 on hv-cinder-85918 Sep 26 05:35:01.398231 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-fd2be8f6-86a1-42d8-9678-7565271ef071 req-29329b03-c954-4775-8354-1024374f8cd1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097699 Sep 26 05:35:01.399477 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 379/738] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:35:01.501148 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-dc6ca975-6fcb-4860-9ac3-4a9e26b2a6d0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:01.509668 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-dc6ca975-6fcb-4860-9ac3-4a9e26b2a6d0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1571 microversion: 2.1 time: 0.179166 Sep 26 05:35:01.510248 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 360/739] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:01 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1571 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:35:01.533027 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-187d4c36-d54e-41c2-b9e9-c7a0e864ab93 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:35:01.533709 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-187d4c36-d54e-41c2-b9e9-c7a0e864ab93 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:01.540571 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-187d4c36-d54e-41c2-b9e9-c7a0e864ab93 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:01.541067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-187d4c36-d54e-41c2-b9e9-c7a0e864ab93 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:01.541499 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-187d4c36-d54e-41c2-b9e9-c7a0e864ab93 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:01.542199 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-187d4c36-d54e-41c2-b9e9-c7a0e864ab93 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:01.542654 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-187d4c36-d54e-41c2-b9e9-c7a0e864ab93 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:01.543076 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-187d4c36-d54e-41c2-b9e9-c7a0e864ab93 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:01.575658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-187d4c36-d54e-41c2-b9e9-c7a0e864ab93 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120806) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 26 05:35:01.657952 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-187d4c36-d54e-41c2-b9e9-c7a0e864ab93 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "POST /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d/action" status: 202 len: 0 microversion: 2.1 time: 0.128983 Sep 26 05:35:01.659434 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 380/740] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 05:35:01 2022] POST /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:35:01.669844 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1084c630-91d7-4280-b7f0-a9be859754d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:01.670515 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1084c630-91d7-4280-b7f0-a9be859754d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:01.679337 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1084c630-91d7-4280-b7f0-a9be859754d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:01.679842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1084c630-91d7-4280-b7f0-a9be859754d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:01.680300 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1084c630-91d7-4280-b7f0-a9be859754d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:01.681061 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1084c630-91d7-4280-b7f0-a9be859754d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:01.682589 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1084c630-91d7-4280-b7f0-a9be859754d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:01.683098 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1084c630-91d7-4280-b7f0-a9be859754d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:01.874425 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1084c630-91d7-4280-b7f0-a9be859754d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:01.884569 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1084c630-91d7-4280-b7f0-a9be859754d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1519 microversion: 2.1 time: 0.220482 Sep 26 05:35:01.885252 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 361/741] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:01 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1519 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:01.945286 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-facf920d-c7c1-42b7-affc-c16fdc33f309 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:01.946604 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-facf920d-c7c1-42b7-affc-c16fdc33f309 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:01.955381 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-facf920d-c7c1-42b7-affc-c16fdc33f309 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:01.955866 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-facf920d-c7c1-42b7-affc-c16fdc33f309 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:01.956325 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-facf920d-c7c1-42b7-affc-c16fdc33f309 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:01.957018 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-facf920d-c7c1-42b7-affc-c16fdc33f309 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:01.957492 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-facf920d-c7c1-42b7-affc-c16fdc33f309 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:01.957913 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-facf920d-c7c1-42b7-affc-c16fdc33f309 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:01.993851 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-facf920d-c7c1-42b7-affc-c16fdc33f309 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:01.994339 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-facf920d-c7c1-42b7-affc-c16fdc33f309 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:01.995055 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-facf920d-c7c1-42b7-affc-c16fdc33f309 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:01.995669 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-facf920d-c7c1-42b7-affc-c16fdc33f309 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lazy-loading 'fault' on Instance uuid 43405413-d653-4c48-acc8-3af217fb7ea2 {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:35:02.049965 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-facf920d-c7c1-42b7-affc-c16fdc33f309 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:02.060637 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-facf920d-c7c1-42b7-affc-c16fdc33f309 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 200 len: 1330 microversion: 2.1 time: 0.120126 Sep 26 05:35:02.061980 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 381/742] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:01 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 1330 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:02.214470 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-1d2a4998-114e-4540-b428-bfa3800be4b1 req-c3c81d41-48b2-47cf-94b7-df19edd858d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b60837af-4528-4e98-bb46-0e80e3270c0d", "name": "network-vif-unplugged", "status": "completed", "tag": "7672989d-ca9b-46a1-b56a-6c9d7ec17b2d"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:35:02.228444 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-1d2a4998-114e-4540-b428-bfa3800be4b1 req-c3c81d41-48b2-47cf-94b7-df19edd858d6 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:02.229329 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-1d2a4998-114e-4540-b428-bfa3800be4b1 req-c3c81d41-48b2-47cf-94b7-df19edd858d6 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:02.229914 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-1d2a4998-114e-4540-b428-bfa3800be4b1 req-c3c81d41-48b2-47cf-94b7-df19edd858d6 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:02.242858 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.compute.server_external_events [req-1d2a4998-114e-4540-b428-bfa3800be4b1 req-c3c81d41-48b2-47cf-94b7-df19edd858d6 service nova] Unable to find a host for instance b60837af-4528-4e98-bb46-0e80e3270c0d. Dropping event network-vif-unplugged {{(pid=120805) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 26 05:35:02.243737 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-1d2a4998-114e-4540-b428-bfa3800be4b1 req-c3c81d41-48b2-47cf-94b7-df19edd858d6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.100394 Sep 26 05:35:02.244349 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 362/743] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 102 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 26 05:35:02.909633 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b6486f82-7a61-4ee3-a1a3-fb8603ce0770 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:02.910254 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b6486f82-7a61-4ee3-a1a3-fb8603ce0770 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:02.917626 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b6486f82-7a61-4ee3-a1a3-fb8603ce0770 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:02.918114 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b6486f82-7a61-4ee3-a1a3-fb8603ce0770 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:02.918557 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b6486f82-7a61-4ee3-a1a3-fb8603ce0770 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:02.919252 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b6486f82-7a61-4ee3-a1a3-fb8603ce0770 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:02.919710 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b6486f82-7a61-4ee3-a1a3-fb8603ce0770 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:02.920137 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b6486f82-7a61-4ee3-a1a3-fb8603ce0770 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:03.048420 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b6486f82-7a61-4ee3-a1a3-fb8603ce0770 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:03.056314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b6486f82-7a61-4ee3-a1a3-fb8603ce0770 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1521 microversion: 2.1 time: 0.150532 Sep 26 05:35:03.056880 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 382/744] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:02 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:03.086247 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b6dde47e-6157-4987-a2be-701e6e2eacef tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:03.086867 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b6dde47e-6157-4987-a2be-701e6e2eacef tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:03.093734 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6dde47e-6157-4987-a2be-701e6e2eacef tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:03.094235 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6dde47e-6157-4987-a2be-701e6e2eacef tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:03.094662 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6dde47e-6157-4987-a2be-701e6e2eacef tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:03.095345 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6dde47e-6157-4987-a2be-701e6e2eacef tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:03.095785 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6dde47e-6157-4987-a2be-701e6e2eacef tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:03.096207 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6dde47e-6157-4987-a2be-701e6e2eacef tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:03.110226 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-b6dde47e-6157-4987-a2be-701e6e2eacef tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] HTTP exception thrown: Instance 43405413-d653-4c48-acc8-3af217fb7ea2 could not be found. Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b6dde47e-6157-4987-a2be-701e6e2eacef tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Request method failure captured: Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 HTTP/1.1 Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTi0HNidMJ_uUjz9W9nG4CLXam9AEEcBUxHuJymFks4FVk8X_UREH6vt6sYWIBIpMYwbfop3-Tu9G5rH-U470tWXr7O7oFa6DqY-WLodQcPeOqi33ywVkGIxoXJu-o6j8RNWX3xYPNIu8TNqBir3Si8HbJUdBskNzCM6QioApbM8lh8 Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:35:03.112213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:35:03.113761 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd13dd8ec810435491e3f3cba7cca4d1"}]}] Sep 26 05:35:03.113761 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:35:03.113761 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:35:03.113761 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:35:03.113761 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:35:03.113761 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:35:03.113761 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:35:03.113761 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 48e588ff6d5a4a37b902abadfb6d04fc Sep 26 05:35:03.113761 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:35:03.113761 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:35:03.113761 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance 43405413-d653-4c48-acc8-3af217fb7ea2 could not be found. Sep 26 05:35:03.113761 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': '43405413-d653-4c48-acc8-3af217fb7ea2'} Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43405413-d653-4c48-acc8-3af217fb7ea2 could not be found. Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:35:03.114578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:35:03.117138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:35:03.117138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:35:03.117138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:35:03.117138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:35:03.117138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:35:03.117138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:35:03.117138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:35:03.117138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43405413-d653-4c48-acc8-3af217fb7ea2 could not be found. Sep 26 05:35:03.117138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:35:03.117138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:35:03.117138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:35:03.117138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:35:03.117138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:35:03.117138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:35:03.117138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:35:03.117138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:35:03.117138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43405413-d653-4c48-acc8-3af217fb7ea2 could not be found. Sep 26 05:35:03.117138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:35:03.118505 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b6dde47e-6157-4987-a2be-701e6e2eacef tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Returning 404 to user: Instance 43405413-d653-4c48-acc8-3af217fb7ea2 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:35:03.118505 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b6dde47e-6157-4987-a2be-701e6e2eacef tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 404 len: 111 microversion: 2.1 time: 0.032652 Sep 26 05:35:03.118505 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 363/745] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:03 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:35:03.122669 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-2a00acb4-37b1-4b65-b814-01395dbec9ed tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '.version_select at 0x7fd7b726d280>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:03.141995 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2a00acb4-37b1-4b65-b814-01395dbec9ed tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1549388733" status: 202 len: 0 microversion: 2.1 time: 0.023071 Sep 26 05:35:03.142550 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 383/746] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Sep 26 05:35:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1549388733 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:35:03.773423 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a00d3d7f-39e9-41f0-b9c9-4824632c4a7e tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Action: 'create', calling method: .version_select at 0x7fd7b71c4670>, body: {"keypair": {"name": "tempest-keypair-418654430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPb0Um7rlu56vA8R+oynTxfkzi15DmgqsAYh2bkow8+e9ssDU9SdwYMRPGwBJtHuOnqa/pmcK3RFhZNwBw5KJp7XgYYOswHanclFR6ZItp6Kl2mVmQb9FS0BE3RWVE8b8A=="}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:35:03.788595 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-a00d3d7f-39e9-41f0-b9c9-4824632c4a7e tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Getting quotas for project fd13dd8ec810435491e3f3cba7cca4d1. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:35:03.792335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-a00d3d7f-39e9-41f0-b9c9-4824632c4a7e tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Getting quotas for user 48e588ff6d5a4a37b902abadfb6d04fc and project fd13dd8ec810435491e3f3cba7cca4d1. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:35:03.813538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a00d3d7f-39e9-41f0-b9c9-4824632c4a7e tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044688 Sep 26 05:35:03.814107 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 364/747] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 05:35:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:35:04.081430 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-02a01416-a50c-441e-86bd-871a128c8170 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:04.082221 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-02a01416-a50c-441e-86bd-871a128c8170 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:04.091931 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-02a01416-a50c-441e-86bd-871a128c8170 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:04.092680 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-02a01416-a50c-441e-86bd-871a128c8170 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:04.093126 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-02a01416-a50c-441e-86bd-871a128c8170 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:04.093869 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-02a01416-a50c-441e-86bd-871a128c8170 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:04.094326 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-02a01416-a50c-441e-86bd-871a128c8170 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:04.094759 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-02a01416-a50c-441e-86bd-871a128c8170 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:04.274785 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-02a01416-a50c-441e-86bd-871a128c8170 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:04.283337 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-02a01416-a50c-441e-86bd-871a128c8170 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1577 microversion: 2.1 time: 0.206858 Sep 26 05:35:04.284351 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 384/748] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:04 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1577 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:05.148066 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ec3d7e92-31a9-4b37-a945-f0e596487ed8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1195189927", "imageRef": "d37a4f3d-6311-48af-9e33-4c62c14cdd1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "542c3891-aa7c-4297-a50e-fe5b71cd3cf3"}], "security_groups": [{"name": "tempest-securitygroup--1933888593"}], "key_name": "tempest-keypair-418654430", "user_data": "}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:35:05.249547 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-ec3d7e92-31a9-4b37-a945-f0e596487ed8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] validate_networks() for [('542c3891-aa7c-4297-a50e-fe5b71cd3cf3', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:35:05.309901 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6490b690-4a7f-4657-8c64-28a004cefe3c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:05.310505 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6490b690-4a7f-4657-8c64-28a004cefe3c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:05.316823 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6490b690-4a7f-4657-8c64-28a004cefe3c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:05.317303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6490b690-4a7f-4657-8c64-28a004cefe3c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:05.317735 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6490b690-4a7f-4657-8c64-28a004cefe3c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:05.318534 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6490b690-4a7f-4657-8c64-28a004cefe3c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:05.319002 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6490b690-4a7f-4657-8c64-28a004cefe3c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:05.319421 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6490b690-4a7f-4657-8c64-28a004cefe3c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:05.545508 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6490b690-4a7f-4657-8c64-28a004cefe3c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:05.553767 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6490b690-4a7f-4657-8c64-28a004cefe3c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1577 microversion: 2.1 time: 0.247714 Sep 26 05:35:05.554606 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 385/749] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:05 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1577 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:35:05.677778 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-ec3d7e92-31a9-4b37-a945-f0e596487ed8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:35:05.678197 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-ec3d7e92-31a9-4b37-a945-f0e596487ed8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:35:05.678677 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-ec3d7e92-31a9-4b37-a945-f0e596487ed8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:35:05.679091 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-ec3d7e92-31a9-4b37-a945-f0e596487ed8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:35:05.679507 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-ec3d7e92-31a9-4b37-a945-f0e596487ed8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:35:05.688379 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec3d7e92-31a9-4b37-a945-f0e596487ed8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:05.688865 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec3d7e92-31a9-4b37-a945-f0e596487ed8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:05.689304 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec3d7e92-31a9-4b37-a945-f0e596487ed8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:05.690037 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec3d7e92-31a9-4b37-a945-f0e596487ed8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:05.690495 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec3d7e92-31a9-4b37-a945-f0e596487ed8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:05.690922 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec3d7e92-31a9-4b37-a945-f0e596487ed8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:05.707393 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-ec3d7e92-31a9-4b37-a945-f0e596487ed8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Getting quotas for project fd13dd8ec810435491e3f3cba7cca4d1. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:35:05.711832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-ec3d7e92-31a9-4b37-a945-f0e596487ed8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Getting quotas for user 48e588ff6d5a4a37b902abadfb6d04fc and project fd13dd8ec810435491e3f3cba7cca4d1. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:35:05.722656 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ec3d7e92-31a9-4b37-a945-f0e596487ed8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:35:05.725800 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ec3d7e92-31a9-4b37-a945-f0e596487ed8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d37a4f3d-6311-48af-9e33-4c62c14cdd1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:35:05.773056 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ec3d7e92-31a9-4b37-a945-f0e596487ed8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.629389 Sep 26 05:35:05.773697 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 365/750] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:35:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:35:05.785062 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-be5b6802-3052-440d-a653-8ad8e222a72c tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:05.785520 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-be5b6802-3052-440d-a653-8ad8e222a72c tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:05.840075 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-be5b6802-3052-440d-a653-8ad8e222a72c tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:05.847158 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-be5b6802-3052-440d-a653-8ad8e222a72c tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 200 len: 1241 microversion: 2.1 time: 0.066160 Sep 26 05:35:05.847620 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 386/751] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:05 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:06.577948 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a0e3fefa-7cca-4244-9164-e5f0fe8a3601 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:06.578404 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a0e3fefa-7cca-4244-9164-e5f0fe8a3601 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:06.587674 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a0e3fefa-7cca-4244-9164-e5f0fe8a3601 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:06.588157 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a0e3fefa-7cca-4244-9164-e5f0fe8a3601 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:06.588642 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a0e3fefa-7cca-4244-9164-e5f0fe8a3601 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:06.589323 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a0e3fefa-7cca-4244-9164-e5f0fe8a3601 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:06.589863 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a0e3fefa-7cca-4244-9164-e5f0fe8a3601 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:06.590290 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a0e3fefa-7cca-4244-9164-e5f0fe8a3601 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:06.723426 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a0e3fefa-7cca-4244-9164-e5f0fe8a3601 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:06.731658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a0e3fefa-7cca-4244-9164-e5f0fe8a3601 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1577 microversion: 2.1 time: 0.158272 Sep 26 05:35:06.732217 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 366/752] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:06 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:06.873469 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-80de2076-9d61-4061-9fe5-059e52021492 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:06.874010 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-80de2076-9d61-4061-9fe5-059e52021492 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:06.876444 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:06.883141 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-80de2076-9d61-4061-9fe5-059e52021492 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:06.883656 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-80de2076-9d61-4061-9fe5-059e52021492 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:06.884099 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-80de2076-9d61-4061-9fe5-059e52021492 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:06.884841 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-80de2076-9d61-4061-9fe5-059e52021492 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:06.885295 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-80de2076-9d61-4061-9fe5-059e52021492 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:06.885723 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-80de2076-9d61-4061-9fe5-059e52021492 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:06.946119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-80de2076-9d61-4061-9fe5-059e52021492 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:06.953835 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-80de2076-9d61-4061-9fe5-059e52021492 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 200 len: 1293 microversion: 2.1 time: 0.084220 Sep 26 05:35:06.954400 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 387/753] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:06 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:07.754994 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1dec8d15-6c8a-4900-9758-3fce73a4cc10 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:07.756100 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1dec8d15-6c8a-4900-9758-3fce73a4cc10 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:07.760304 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:07.764295 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1dec8d15-6c8a-4900-9758-3fce73a4cc10 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:07.764796 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1dec8d15-6c8a-4900-9758-3fce73a4cc10 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:07.765234 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1dec8d15-6c8a-4900-9758-3fce73a4cc10 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:07.765931 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1dec8d15-6c8a-4900-9758-3fce73a4cc10 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:07.766387 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1dec8d15-6c8a-4900-9758-3fce73a4cc10 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:07.766810 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1dec8d15-6c8a-4900-9758-3fce73a4cc10 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:07.940346 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1dec8d15-6c8a-4900-9758-3fce73a4cc10 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:07.949730 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1dec8d15-6c8a-4900-9758-3fce73a4cc10 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1577 microversion: 2.1 time: 0.198643 Sep 26 05:35:07.952305 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 367/754] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:07 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1577 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:07.977389 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-20f2ac40-ffd2-4927-a3a5-6db203fbe3a9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:07.978680 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-20f2ac40-ffd2-4927-a3a5-6db203fbe3a9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:07.985585 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20f2ac40-ffd2-4927-a3a5-6db203fbe3a9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:07.986228 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20f2ac40-ffd2-4927-a3a5-6db203fbe3a9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:07.986673 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20f2ac40-ffd2-4927-a3a5-6db203fbe3a9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:07.987373 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20f2ac40-ffd2-4927-a3a5-6db203fbe3a9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:07.988013 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20f2ac40-ffd2-4927-a3a5-6db203fbe3a9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:07.988575 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-20f2ac40-ffd2-4927-a3a5-6db203fbe3a9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:08.009024 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:08.130299 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-20f2ac40-ffd2-4927-a3a5-6db203fbe3a9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:08.139772 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-20f2ac40-ffd2-4927-a3a5-6db203fbe3a9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 200 len: 1367 microversion: 2.1 time: 0.166767 Sep 26 05:35:08.140373 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 388/755] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:07 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:08.504050 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-1add4d17-36ae-4f68-a2b2-e674533da934 req-ec0679e4-f163-4fce-adce-c8230a87779d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd42d52-e8d1-447f-882e-7151c7010c2d", "tag": "a50f5065-0980-4bdd-bcd4-888e4c8e6890"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:35:08.514903 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-1add4d17-36ae-4f68-a2b2-e674533da934 req-ec0679e4-f163-4fce-adce-c8230a87779d service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:08.515571 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-1add4d17-36ae-4f68-a2b2-e674533da934 req-ec0679e4-f163-4fce-adce-c8230a87779d service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:08.516092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-1add4d17-36ae-4f68-a2b2-e674533da934 req-ec0679e4-f163-4fce-adce-c8230a87779d service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:08.528614 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-1add4d17-36ae-4f68-a2b2-e674533da934 req-ec0679e4-f163-4fce-adce-c8230a87779d service nova] Creating event network-changed:a50f5065-0980-4bdd-bcd4-888e4c8e6890 for instance acd42d52-e8d1-447f-882e-7151c7010c2d on hv-cinder-85918 Sep 26 05:35:08.533473 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-1add4d17-36ae-4f68-a2b2-e674533da934 req-ec0679e4-f163-4fce-adce-c8230a87779d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033219 Sep 26 05:35:08.534075 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 368/756] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:35:08.973497 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e8d03e98-a255-402c-9e22-4cca9431c782 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:08.974365 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e8d03e98-a255-402c-9e22-4cca9431c782 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:08.980519 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e8d03e98-a255-402c-9e22-4cca9431c782 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:08.981093 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e8d03e98-a255-402c-9e22-4cca9431c782 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:08.981415 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e8d03e98-a255-402c-9e22-4cca9431c782 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:08.982102 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e8d03e98-a255-402c-9e22-4cca9431c782 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:08.982553 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e8d03e98-a255-402c-9e22-4cca9431c782 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:08.982973 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e8d03e98-a255-402c-9e22-4cca9431c782 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:09.111295 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e8d03e98-a255-402c-9e22-4cca9431c782 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:09.119051 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e8d03e98-a255-402c-9e22-4cca9431c782 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1577 microversion: 2.1 time: 0.149427 Sep 26 05:35:09.119604 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 389/757] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:08 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:09.164375 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-56b19c48-1f9e-4172-a7a7-13190c52a1d0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:09.165074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-56b19c48-1f9e-4172-a7a7-13190c52a1d0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:09.171542 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-56b19c48-1f9e-4172-a7a7-13190c52a1d0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:09.172020 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-56b19c48-1f9e-4172-a7a7-13190c52a1d0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:09.172479 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-56b19c48-1f9e-4172-a7a7-13190c52a1d0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:09.173156 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-56b19c48-1f9e-4172-a7a7-13190c52a1d0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:09.173602 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-56b19c48-1f9e-4172-a7a7-13190c52a1d0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:09.174017 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-56b19c48-1f9e-4172-a7a7-13190c52a1d0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:09.302952 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-56b19c48-1f9e-4172-a7a7-13190c52a1d0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:09.315939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-56b19c48-1f9e-4172-a7a7-13190c52a1d0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 200 len: 1367 microversion: 2.1 time: 0.155807 Sep 26 05:35:09.316594 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 369/758] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:09 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:10.143835 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-0d5cbf1f-8c12-4337-bf88-1cfc613622d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:10.144476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-0d5cbf1f-8c12-4337-bf88-1cfc613622d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:10.151299 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0d5cbf1f-8c12-4337-bf88-1cfc613622d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:10.151777 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0d5cbf1f-8c12-4337-bf88-1cfc613622d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:10.152210 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0d5cbf1f-8c12-4337-bf88-1cfc613622d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:10.152926 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0d5cbf1f-8c12-4337-bf88-1cfc613622d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:10.153382 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0d5cbf1f-8c12-4337-bf88-1cfc613622d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:10.153806 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0d5cbf1f-8c12-4337-bf88-1cfc613622d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:10.282522 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0d5cbf1f-8c12-4337-bf88-1cfc613622d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:10.291017 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-0d5cbf1f-8c12-4337-bf88-1cfc613622d1 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1577 microversion: 2.1 time: 0.151070 Sep 26 05:35:10.291584 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 390/759] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:10 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:10.339583 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-48de4718-a3d4-4602-82ff-5f837d6812d9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:10.340202 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-48de4718-a3d4-4602-82ff-5f837d6812d9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:10.346779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-48de4718-a3d4-4602-82ff-5f837d6812d9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:10.347210 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-48de4718-a3d4-4602-82ff-5f837d6812d9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:10.347656 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-48de4718-a3d4-4602-82ff-5f837d6812d9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:10.348405 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-48de4718-a3d4-4602-82ff-5f837d6812d9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:10.349633 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-48de4718-a3d4-4602-82ff-5f837d6812d9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:10.350269 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-48de4718-a3d4-4602-82ff-5f837d6812d9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:10.478927 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-48de4718-a3d4-4602-82ff-5f837d6812d9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:10.486551 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-48de4718-a3d4-4602-82ff-5f837d6812d9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 200 len: 1367 microversion: 2.1 time: 0.150826 Sep 26 05:35:10.487114 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 370/760] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:10 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:11.313636 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-4458bf33-08ab-47e4-b014-96dc8c8584b7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:11.314247 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-4458bf33-08ab-47e4-b014-96dc8c8584b7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:11.320684 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4458bf33-08ab-47e4-b014-96dc8c8584b7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:11.321166 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4458bf33-08ab-47e4-b014-96dc8c8584b7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:11.321602 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4458bf33-08ab-47e4-b014-96dc8c8584b7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:11.322286 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4458bf33-08ab-47e4-b014-96dc8c8584b7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:11.322739 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4458bf33-08ab-47e4-b014-96dc8c8584b7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:11.323162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4458bf33-08ab-47e4-b014-96dc8c8584b7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:11.450046 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-4458bf33-08ab-47e4-b014-96dc8c8584b7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:11.457725 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-4458bf33-08ab-47e4-b014-96dc8c8584b7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1577 microversion: 2.1 time: 0.147957 Sep 26 05:35:11.458375 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 391/761] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:11 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:11.509427 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-292d5c48-4aa4-4f0f-8859-b6fcc2fb3a50 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:11.510034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-292d5c48-4aa4-4f0f-8859-b6fcc2fb3a50 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:11.516408 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-292d5c48-4aa4-4f0f-8859-b6fcc2fb3a50 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:11.516883 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-292d5c48-4aa4-4f0f-8859-b6fcc2fb3a50 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:11.517313 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-292d5c48-4aa4-4f0f-8859-b6fcc2fb3a50 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:11.517983 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-292d5c48-4aa4-4f0f-8859-b6fcc2fb3a50 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:11.518435 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-292d5c48-4aa4-4f0f-8859-b6fcc2fb3a50 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:11.518860 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-292d5c48-4aa4-4f0f-8859-b6fcc2fb3a50 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:11.647571 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-292d5c48-4aa4-4f0f-8859-b6fcc2fb3a50 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:11.655342 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-292d5c48-4aa4-4f0f-8859-b6fcc2fb3a50 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 200 len: 1367 microversion: 2.1 time: 0.149862 Sep 26 05:35:11.655836 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 371/762] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:11 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:35:12.394997 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f5919fba-3b4c-47a0-a841-349ae02b9b07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:12.396111 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f5919fba-3b4c-47a0-a841-349ae02b9b07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:12.402594 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f5919fba-3b4c-47a0-a841-349ae02b9b07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:12.403076 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f5919fba-3b4c-47a0-a841-349ae02b9b07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:12.403526 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f5919fba-3b4c-47a0-a841-349ae02b9b07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:12.404218 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f5919fba-3b4c-47a0-a841-349ae02b9b07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:12.404698 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f5919fba-3b4c-47a0-a841-349ae02b9b07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:12.405122 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f5919fba-3b4c-47a0-a841-349ae02b9b07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:12.481700 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-44c9366c-75a8-4e0c-ba5f-cd3d133ecc27 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:12.482527 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-44c9366c-75a8-4e0c-ba5f-cd3d133ecc27 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:12.484928 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-f5919fba-3b4c-47a0-a841-349ae02b9b07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lazy-loading 'services' on Instance uuid 30c51093-517b-4a33-9d80-8bf0e1747e75 {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:35:12.488876 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-44c9366c-75a8-4e0c-ba5f-cd3d133ecc27 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:12.489958 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-44c9366c-75a8-4e0c-ba5f-cd3d133ecc27 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:12.490454 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-44c9366c-75a8-4e0c-ba5f-cd3d133ecc27 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:12.491261 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-44c9366c-75a8-4e0c-ba5f-cd3d133ecc27 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:12.491717 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-44c9366c-75a8-4e0c-ba5f-cd3d133ecc27 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:12.492144 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-44c9366c-75a8-4e0c-ba5f-cd3d133ecc27 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:12.495174 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:12.562867 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f5919fba-3b4c-47a0-a841-349ae02b9b07 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "DELETE /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/os-volume_attachments/6b54d688-fb3b-40b0-b495-613a548f923d" status: 202 len: 0 microversion: 2.1 time: 0.171864 Sep 26 05:35:12.564061 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 392/763] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 05:35:12 2022] DELETE /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/os-volume_attachments/6b54d688-fb3b-40b0-b495-613a548f923d => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:35:12.574063 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-4828dd83-b8f8-4977-b9fa-b421b5380977 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:12.577432 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-4828dd83-b8f8-4977-b9fa-b421b5380977 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:12.585059 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4828dd83-b8f8-4977-b9fa-b421b5380977 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:12.585655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4828dd83-b8f8-4977-b9fa-b421b5380977 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:12.586159 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4828dd83-b8f8-4977-b9fa-b421b5380977 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:12.586944 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4828dd83-b8f8-4977-b9fa-b421b5380977 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:12.587492 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4828dd83-b8f8-4977-b9fa-b421b5380977 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:12.588119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4828dd83-b8f8-4977-b9fa-b421b5380977 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:12.625613 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-4828dd83-b8f8-4977-b9fa-b421b5380977 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056501 Sep 26 05:35:12.626548 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 393/764] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:35:12 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:35:12.649068 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-44c9366c-75a8-4e0c-ba5f-cd3d133ecc27 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:12.660712 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-44c9366c-75a8-4e0c-ba5f-cd3d133ecc27 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1577 microversion: 2.1 time: 0.183986 Sep 26 05:35:12.662350 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 372/765] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:12 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:12.682776 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-efc38f78-a5a6-45da-8551-7cb7da440a6d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:12.683328 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-efc38f78-a5a6-45da-8551-7cb7da440a6d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:12.689365 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-efc38f78-a5a6-45da-8551-7cb7da440a6d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:12.689833 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-efc38f78-a5a6-45da-8551-7cb7da440a6d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:12.690260 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-efc38f78-a5a6-45da-8551-7cb7da440a6d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:12.690953 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-efc38f78-a5a6-45da-8551-7cb7da440a6d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:12.691398 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-efc38f78-a5a6-45da-8551-7cb7da440a6d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:12.691830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-efc38f78-a5a6-45da-8551-7cb7da440a6d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:12.825016 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-efc38f78-a5a6-45da-8551-7cb7da440a6d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:12.832551 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-efc38f78-a5a6-45da-8551-7cb7da440a6d tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 200 len: 1367 microversion: 2.1 time: 0.155110 Sep 26 05:35:12.833747 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 394/766] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:12 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:13.639345 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-65736483-74c6-4228-93a2-e814bc849b96 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:13.641525 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-65736483-74c6-4228-93a2-e814bc849b96 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:13.647965 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-65736483-74c6-4228-93a2-e814bc849b96 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:13.648475 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-65736483-74c6-4228-93a2-e814bc849b96 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:13.648912 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-65736483-74c6-4228-93a2-e814bc849b96 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:13.649588 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-65736483-74c6-4228-93a2-e814bc849b96 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:13.650115 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-65736483-74c6-4228-93a2-e814bc849b96 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:13.650444 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-65736483-74c6-4228-93a2-e814bc849b96 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:13.680153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-65736483-74c6-4228-93a2-e814bc849b96 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044721 Sep 26 05:35:13.680734 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 373/767] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:35:13 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:35:13.684905 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-460e7f78-fb46-4e27-888e-7b7e3a02a1e8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:13.685555 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-460e7f78-fb46-4e27-888e-7b7e3a02a1e8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:13.691791 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-460e7f78-fb46-4e27-888e-7b7e3a02a1e8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:13.692291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-460e7f78-fb46-4e27-888e-7b7e3a02a1e8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:13.692732 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-460e7f78-fb46-4e27-888e-7b7e3a02a1e8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:13.693455 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-460e7f78-fb46-4e27-888e-7b7e3a02a1e8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:13.693894 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-460e7f78-fb46-4e27-888e-7b7e3a02a1e8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:13.694315 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-460e7f78-fb46-4e27-888e-7b7e3a02a1e8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:13.764700 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fc0d773f-cf5b-4f80-b9c1-101815a41e40 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:13.765230 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fc0d773f-cf5b-4f80-b9c1-101815a41e40 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:13.771163 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fc0d773f-cf5b-4f80-b9c1-101815a41e40 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:13.771782 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fc0d773f-cf5b-4f80-b9c1-101815a41e40 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:13.772218 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fc0d773f-cf5b-4f80-b9c1-101815a41e40 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:13.772918 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fc0d773f-cf5b-4f80-b9c1-101815a41e40 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:13.773366 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fc0d773f-cf5b-4f80-b9c1-101815a41e40 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:13.773786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fc0d773f-cf5b-4f80-b9c1-101815a41e40 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:13.799377 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fc0d773f-cf5b-4f80-b9c1-101815a41e40 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Going to try to terminate instance {{(pid=120805) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:35:13.827945 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-460e7f78-fb46-4e27-888e-7b7e3a02a1e8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:13.836368 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-460e7f78-fb46-4e27-888e-7b7e3a02a1e8 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1577 microversion: 2.1 time: 0.155176 Sep 26 05:35:13.837186 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 395/768] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:13 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:35:13.858621 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b58e8919-a390-48b8-9491-ea663e18ef89 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:13.859238 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b58e8919-a390-48b8-9491-ea663e18ef89 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:13.865733 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b58e8919-a390-48b8-9491-ea663e18ef89 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:13.866281 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b58e8919-a390-48b8-9491-ea663e18ef89 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:13.866720 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b58e8919-a390-48b8-9491-ea663e18ef89 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:13.867413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b58e8919-a390-48b8-9491-ea663e18ef89 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:13.867867 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b58e8919-a390-48b8-9491-ea663e18ef89 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:13.868308 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b58e8919-a390-48b8-9491-ea663e18ef89 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:13.884957 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fc0d773f-cf5b-4f80-b9c1-101815a41e40 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "DELETE /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 204 len: 0 microversion: 2.1 time: 0.123852 Sep 26 05:35:13.885809 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 374/769] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:35:13 2022] DELETE /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 05:35:13.899822 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-711e9297-0b1a-4dd4-83a1-d3b018d7a8c9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:13.900565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-711e9297-0b1a-4dd4-83a1-d3b018d7a8c9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:13.906580 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-711e9297-0b1a-4dd4-83a1-d3b018d7a8c9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:13.907062 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-711e9297-0b1a-4dd4-83a1-d3b018d7a8c9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:13.907497 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-711e9297-0b1a-4dd4-83a1-d3b018d7a8c9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:13.908185 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-711e9297-0b1a-4dd4-83a1-d3b018d7a8c9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:13.908669 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-711e9297-0b1a-4dd4-83a1-d3b018d7a8c9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:13.909094 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-711e9297-0b1a-4dd4-83a1-d3b018d7a8c9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:14.047111 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b58e8919-a390-48b8-9491-ea663e18ef89 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:14.055742 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b58e8919-a390-48b8-9491-ea663e18ef89 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 200 len: 1367 microversion: 2.1 time: 0.202475 Sep 26 05:35:14.066581 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 396/770] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:13 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:14.080997 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-711e9297-0b1a-4dd4-83a1-d3b018d7a8c9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:14.089934 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-711e9297-0b1a-4dd4-83a1-d3b018d7a8c9 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1690 microversion: 2.1 time: 0.196768 Sep 26 05:35:14.090510 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 375/771] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:13 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1690 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:14.303498 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-6052db61-0ee9-4fc5-9e6d-588e39f34604 req-79e6fe11-460f-4e64-a6c9-f63ccad74591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd42d52-e8d1-447f-882e-7151c7010c2d", "name": "network-vif-plugged", "status": "completed", "tag": "a50f5065-0980-4bdd-bcd4-888e4c8e6890"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:35:14.313681 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-6052db61-0ee9-4fc5-9e6d-588e39f34604 req-79e6fe11-460f-4e64-a6c9-f63ccad74591 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:14.314118 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-6052db61-0ee9-4fc5-9e6d-588e39f34604 req-79e6fe11-460f-4e64-a6c9-f63ccad74591 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:14.314723 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-6052db61-0ee9-4fc5-9e6d-588e39f34604 req-79e6fe11-460f-4e64-a6c9-f63ccad74591 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:14.328776 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-6052db61-0ee9-4fc5-9e6d-588e39f34604 req-79e6fe11-460f-4e64-a6c9-f63ccad74591 service nova] Creating event network-vif-plugged:a50f5065-0980-4bdd-bcd4-888e4c8e6890 for instance acd42d52-e8d1-447f-882e-7151c7010c2d on hv-cinder-85918 Sep 26 05:35:14.333596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-6052db61-0ee9-4fc5-9e6d-588e39f34604 req-79e6fe11-460f-4e64-a6c9-f63ccad74591 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033921 Sep 26 05:35:14.334799 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 397/772] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:35:14.862379 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4b098c57-5303-4eae-b4e3-9f73ea9d16d4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:14.863043 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4b098c57-5303-4eae-b4e3-9f73ea9d16d4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:14.869789 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b098c57-5303-4eae-b4e3-9f73ea9d16d4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:14.870275 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b098c57-5303-4eae-b4e3-9f73ea9d16d4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:14.870706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b098c57-5303-4eae-b4e3-9f73ea9d16d4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:14.871388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b098c57-5303-4eae-b4e3-9f73ea9d16d4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:14.871835 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b098c57-5303-4eae-b4e3-9f73ea9d16d4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:14.872276 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b098c57-5303-4eae-b4e3-9f73ea9d16d4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:15.011453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4b098c57-5303-4eae-b4e3-9f73ea9d16d4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:15.019269 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4b098c57-5303-4eae-b4e3-9f73ea9d16d4 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1577 microversion: 2.1 time: 0.160765 Sep 26 05:35:15.019825 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 376/773] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:14 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:15.079287 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5d68cf2f-b9f3-4804-9ec1-2e50cf8f79d1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:15.080098 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5d68cf2f-b9f3-4804-9ec1-2e50cf8f79d1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:15.088016 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5d68cf2f-b9f3-4804-9ec1-2e50cf8f79d1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:15.088552 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5d68cf2f-b9f3-4804-9ec1-2e50cf8f79d1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:15.089032 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5d68cf2f-b9f3-4804-9ec1-2e50cf8f79d1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:15.089736 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5d68cf2f-b9f3-4804-9ec1-2e50cf8f79d1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:15.090196 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5d68cf2f-b9f3-4804-9ec1-2e50cf8f79d1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:15.090623 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5d68cf2f-b9f3-4804-9ec1-2e50cf8f79d1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:15.114613 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b0e3a92a-475d-4eed-9ace-9925384d32aa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:15.115475 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b0e3a92a-475d-4eed-9ace-9925384d32aa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:15.121337 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b0e3a92a-475d-4eed-9ace-9925384d32aa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:15.121816 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b0e3a92a-475d-4eed-9ace-9925384d32aa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:15.122304 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b0e3a92a-475d-4eed-9ace-9925384d32aa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:15.122989 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b0e3a92a-475d-4eed-9ace-9925384d32aa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:15.123440 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b0e3a92a-475d-4eed-9ace-9925384d32aa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:15.123866 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b0e3a92a-475d-4eed-9ace-9925384d32aa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:15.285537 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5d68cf2f-b9f3-4804-9ec1-2e50cf8f79d1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:15.293692 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5d68cf2f-b9f3-4804-9ec1-2e50cf8f79d1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 200 len: 1367 microversion: 2.1 time: 0.218554 Sep 26 05:35:15.294258 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 398/774] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:15 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:15.300240 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b0e3a92a-475d-4eed-9ace-9925384d32aa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:15.308848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b0e3a92a-475d-4eed-9ace-9925384d32aa tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1690 microversion: 2.1 time: 0.198228 Sep 26 05:35:15.309434 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 377/775] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:15 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1690 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:35:16.043231 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d847cd73-8ab6-4530-ae94-698f3b885a88 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:16.043843 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d847cd73-8ab6-4530-ae94-698f3b885a88 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:16.045840 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:16.051203 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d847cd73-8ab6-4530-ae94-698f3b885a88 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:16.051692 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d847cd73-8ab6-4530-ae94-698f3b885a88 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:16.052124 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d847cd73-8ab6-4530-ae94-698f3b885a88 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:16.053433 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d847cd73-8ab6-4530-ae94-698f3b885a88 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:16.053879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d847cd73-8ab6-4530-ae94-698f3b885a88 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:16.054298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d847cd73-8ab6-4530-ae94-698f3b885a88 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:16.196163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d847cd73-8ab6-4530-ae94-698f3b885a88 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:16.204883 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d847cd73-8ab6-4530-ae94-698f3b885a88 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1577 microversion: 2.1 time: 0.165417 Sep 26 05:35:16.205465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 399/776] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:16 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:16.317308 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0dad56b4-388f-49a0-a971-77c62520fab1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:16.317952 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0dad56b4-388f-49a0-a971-77c62520fab1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:16.320759 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:16.321728 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=10 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:16.329022 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0dad56b4-388f-49a0-a971-77c62520fab1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:16.329710 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0dad56b4-388f-49a0-a971-77c62520fab1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:16.330151 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0dad56b4-388f-49a0-a971-77c62520fab1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:16.330847 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0dad56b4-388f-49a0-a971-77c62520fab1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:16.331302 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0dad56b4-388f-49a0-a971-77c62520fab1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:16.331726 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0dad56b4-388f-49a0-a971-77c62520fab1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:16.332615 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-ceb5432b-7e7f-4bb0-9f42-9232bbada68c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:16.333234 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-ceb5432b-7e7f-4bb0-9f42-9232bbada68c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:16.339709 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ceb5432b-7e7f-4bb0-9f42-9232bbada68c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:16.340217 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ceb5432b-7e7f-4bb0-9f42-9232bbada68c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:16.340724 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ceb5432b-7e7f-4bb0-9f42-9232bbada68c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:16.341424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ceb5432b-7e7f-4bb0-9f42-9232bbada68c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:16.341876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ceb5432b-7e7f-4bb0-9f42-9232bbada68c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:16.342301 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ceb5432b-7e7f-4bb0-9f42-9232bbada68c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:16.530704 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0dad56b4-388f-49a0-a971-77c62520fab1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:16.534934 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-ceb5432b-7e7f-4bb0-9f42-9232bbada68c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:16.538473 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0dad56b4-388f-49a0-a971-77c62520fab1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 200 len: 1367 microversion: 2.1 time: 0.224990 Sep 26 05:35:16.539038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 378/777] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:16 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:16.542849 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-ceb5432b-7e7f-4bb0-9f42-9232bbada68c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1690 microversion: 2.1 time: 0.213952 Sep 26 05:35:16.543588 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 400/778] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:16 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1690 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:16.543813 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-242766bc-e0e6-4f99-9996-078703c21cb3 req-59f98ce2-ab5f-45f6-8a41-58621d4b18a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b60837af-4528-4e98-bb46-0e80e3270c0d", "name": "network-vif-plugged", "status": "completed", "tag": "7672989d-ca9b-46a1-b56a-6c9d7ec17b2d"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:35:16.553147 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-242766bc-e0e6-4f99-9996-078703c21cb3 req-59f98ce2-ab5f-45f6-8a41-58621d4b18a0 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:16.553631 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-242766bc-e0e6-4f99-9996-078703c21cb3 req-59f98ce2-ab5f-45f6-8a41-58621d4b18a0 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:16.554057 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-242766bc-e0e6-4f99-9996-078703c21cb3 req-59f98ce2-ab5f-45f6-8a41-58621d4b18a0 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:16.564948 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-242766bc-e0e6-4f99-9996-078703c21cb3 req-59f98ce2-ab5f-45f6-8a41-58621d4b18a0 service nova] Creating event network-vif-plugged:7672989d-ca9b-46a1-b56a-6c9d7ec17b2d for instance b60837af-4528-4e98-bb46-0e80e3270c0d on hv-cinder-85918 Sep 26 05:35:16.570223 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-242766bc-e0e6-4f99-9996-078703c21cb3 req-59f98ce2-ab5f-45f6-8a41-58621d4b18a0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030105 Sep 26 05:35:16.570801 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 379/779] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:35:17.229777 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f252b7d7-22cb-4acc-b279-34063b40551a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:17.230389 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f252b7d7-22cb-4acc-b279-34063b40551a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:17.236872 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f252b7d7-22cb-4acc-b279-34063b40551a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:17.237349 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f252b7d7-22cb-4acc-b279-34063b40551a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:17.237781 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f252b7d7-22cb-4acc-b279-34063b40551a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:17.238464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f252b7d7-22cb-4acc-b279-34063b40551a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:17.238920 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f252b7d7-22cb-4acc-b279-34063b40551a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:17.239343 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f252b7d7-22cb-4acc-b279-34063b40551a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:17.370618 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f252b7d7-22cb-4acc-b279-34063b40551a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:17.378301 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f252b7d7-22cb-4acc-b279-34063b40551a tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1577 microversion: 2.1 time: 0.152681 Sep 26 05:35:17.378859 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 401/780] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:17 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:17.562296 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bae3a1e2-f603-4749-9c20-82ddf6b234a8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:17.562999 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bae3a1e2-f603-4749-9c20-82ddf6b234a8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:17.565679 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-691f0a3a-8779-49d5-acf7-35cbb26a229a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:17.566298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-691f0a3a-8779-49d5-acf7-35cbb26a229a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:17.569485 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bae3a1e2-f603-4749-9c20-82ddf6b234a8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:17.570000 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bae3a1e2-f603-4749-9c20-82ddf6b234a8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:17.570437 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bae3a1e2-f603-4749-9c20-82ddf6b234a8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:17.571128 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bae3a1e2-f603-4749-9c20-82ddf6b234a8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:17.571577 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bae3a1e2-f603-4749-9c20-82ddf6b234a8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:17.572001 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bae3a1e2-f603-4749-9c20-82ddf6b234a8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:17.572113 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-691f0a3a-8779-49d5-acf7-35cbb26a229a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:17.572557 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-691f0a3a-8779-49d5-acf7-35cbb26a229a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:17.572991 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-691f0a3a-8779-49d5-acf7-35cbb26a229a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:17.573676 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-691f0a3a-8779-49d5-acf7-35cbb26a229a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:17.574125 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-691f0a3a-8779-49d5-acf7-35cbb26a229a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:17.574732 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-691f0a3a-8779-49d5-acf7-35cbb26a229a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:17.757220 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bae3a1e2-f603-4749-9c20-82ddf6b234a8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:17.765212 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bae3a1e2-f603-4749-9c20-82ddf6b234a8 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 200 len: 1367 microversion: 2.1 time: 0.207498 Sep 26 05:35:17.765694 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 380/781] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:17 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:17.767673 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-691f0a3a-8779-49d5-acf7-35cbb26a229a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:17.775927 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-691f0a3a-8779-49d5-acf7-35cbb26a229a tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1690 microversion: 2.1 time: 0.213977 Sep 26 05:35:17.776502 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 402/782] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:17 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1690 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:35:18.402119 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c425e246-8312-435a-aee6-e63199a003a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:18.402650 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c425e246-8312-435a-aee6-e63199a003a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:18.408692 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c425e246-8312-435a-aee6-e63199a003a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:18.409178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c425e246-8312-435a-aee6-e63199a003a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:18.409612 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c425e246-8312-435a-aee6-e63199a003a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:18.410324 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c425e246-8312-435a-aee6-e63199a003a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:18.410755 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c425e246-8312-435a-aee6-e63199a003a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:18.411178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c425e246-8312-435a-aee6-e63199a003a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:18.537768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c425e246-8312-435a-aee6-e63199a003a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:18.545412 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c425e246-8312-435a-aee6-e63199a003a0 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1577 microversion: 2.1 time: 0.147266 Sep 26 05:35:18.545974 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 381/783] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:18 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1577 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:35:18.789589 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f4d9f286-1a05-4bf4-97a5-6973424fcc9f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:18.790180 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f4d9f286-1a05-4bf4-97a5-6973424fcc9f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:18.796645 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f4d9f286-1a05-4bf4-97a5-6973424fcc9f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:18.797122 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f4d9f286-1a05-4bf4-97a5-6973424fcc9f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:18.797558 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f4d9f286-1a05-4bf4-97a5-6973424fcc9f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:18.798239 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f4d9f286-1a05-4bf4-97a5-6973424fcc9f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:18.798735 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f4d9f286-1a05-4bf4-97a5-6973424fcc9f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:18.798861 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1350be12-260f-4106-b857-f351daac9c23 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:18.799361 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f4d9f286-1a05-4bf4-97a5-6973424fcc9f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:18.799478 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1350be12-260f-4106-b857-f351daac9c23 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:18.806815 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1350be12-260f-4106-b857-f351daac9c23 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:18.807306 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1350be12-260f-4106-b857-f351daac9c23 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:18.807775 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1350be12-260f-4106-b857-f351daac9c23 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:18.808479 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1350be12-260f-4106-b857-f351daac9c23 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:18.808937 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1350be12-260f-4106-b857-f351daac9c23 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:18.809364 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1350be12-260f-4106-b857-f351daac9c23 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:19.253719 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f4d9f286-1a05-4bf4-97a5-6973424fcc9f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:19.262451 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f4d9f286-1a05-4bf4-97a5-6973424fcc9f tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 200 len: 1367 microversion: 2.1 time: 0.477473 Sep 26 05:35:19.266888 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1350be12-260f-4106-b857-f351daac9c23 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:19.276380 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1350be12-260f-4106-b857-f351daac9c23 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1690 microversion: 2.1 time: 0.481390 Sep 26 05:35:19.277093 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 403/784] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:18 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 1367 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:19.277237 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 382/785] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:18 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1690 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:35:19.569903 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-34382638-4497-448d-a34b-5ec5d99295b9 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:19.571168 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-34382638-4497-448d-a34b-5ec5d99295b9 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:19.577190 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-34382638-4497-448d-a34b-5ec5d99295b9 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:19.577683 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-34382638-4497-448d-a34b-5ec5d99295b9 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:19.578123 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-34382638-4497-448d-a34b-5ec5d99295b9 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:19.578831 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-34382638-4497-448d-a34b-5ec5d99295b9 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:19.579288 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-34382638-4497-448d-a34b-5ec5d99295b9 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:19.579729 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-34382638-4497-448d-a34b-5ec5d99295b9 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:19.790241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-34382638-4497-448d-a34b-5ec5d99295b9 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:19.798143 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-34382638-4497-448d-a34b-5ec5d99295b9 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1577 microversion: 2.1 time: 0.232800 Sep 26 05:35:19.798719 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 404/786] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:19 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1577 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:20.286025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-85cf2b14-872d-41af-a9cf-82a015489fa0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:20.287078 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-85cf2b14-872d-41af-a9cf-82a015489fa0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:20.293629 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-85cf2b14-872d-41af-a9cf-82a015489fa0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:20.294113 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-85cf2b14-872d-41af-a9cf-82a015489fa0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:20.294547 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-85cf2b14-872d-41af-a9cf-82a015489fa0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:20.295310 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-85cf2b14-872d-41af-a9cf-82a015489fa0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:20.295766 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-85cf2b14-872d-41af-a9cf-82a015489fa0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:20.296186 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-85cf2b14-872d-41af-a9cf-82a015489fa0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:20.300136 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-cbe3c83b-61a1-43ea-b2de-9c993566ddcd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:20.300852 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-cbe3c83b-61a1-43ea-b2de-9c993566ddcd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:20.307635 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cbe3c83b-61a1-43ea-b2de-9c993566ddcd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:20.308203 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cbe3c83b-61a1-43ea-b2de-9c993566ddcd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:20.308737 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cbe3c83b-61a1-43ea-b2de-9c993566ddcd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:20.309499 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cbe3c83b-61a1-43ea-b2de-9c993566ddcd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:20.310032 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cbe3c83b-61a1-43ea-b2de-9c993566ddcd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:20.310640 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cbe3c83b-61a1-43ea-b2de-9c993566ddcd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:20.314918 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:20.431538 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-cbe3c83b-61a1-43ea-b2de-9c993566ddcd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:20.440776 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-cbe3c83b-61a1-43ea-b2de-9c993566ddcd tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1622 microversion: 2.1 time: 0.144258 Sep 26 05:35:20.441661 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 405/787] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:20 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1622 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:35:20.456471 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-1c753de2-8a01-4901-bcd9-010b77f0c5b3 req-a32c6664-d2af-4196-b537-a141fbe48469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c51093-517b-4a33-9d80-8bf0e1747e75", "name": "network-vif-deleted", "tag": "322798b9-1af9-46df-bb99-417d8b1d04b3"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:35:20.467367 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-1c753de2-8a01-4901-bcd9-010b77f0c5b3 req-a32c6664-d2af-4196-b537-a141fbe48469 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:20.467935 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-1c753de2-8a01-4901-bcd9-010b77f0c5b3 req-a32c6664-d2af-4196-b537-a141fbe48469 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:20.468462 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-1c753de2-8a01-4901-bcd9-010b77f0c5b3 req-a32c6664-d2af-4196-b537-a141fbe48469 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:20.482420 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-1c753de2-8a01-4901-bcd9-010b77f0c5b3 req-a32c6664-d2af-4196-b537-a141fbe48469 service nova] Creating event network-vif-deleted:322798b9-1af9-46df-bb99-417d8b1d04b3 for instance 30c51093-517b-4a33-9d80-8bf0e1747e75 on hv-cinder-85918 Sep 26 05:35:20.487741 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-1c753de2-8a01-4901-bcd9-010b77f0c5b3 req-a32c6664-d2af-4196-b537-a141fbe48469 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040342 Sep 26 05:35:20.489005 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 406/788] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:35:20.515627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-85cf2b14-872d-41af-a9cf-82a015489fa0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:20.523530 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-85cf2b14-872d-41af-a9cf-82a015489fa0 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 200 len: 1367 microversion: 2.1 time: 0.241406 Sep 26 05:35:20.524176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 383/789] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:20 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:20.823602 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7bcd248a-77cd-448f-8396-4aed5c9f551f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:20.824220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7bcd248a-77cd-448f-8396-4aed5c9f551f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:20.830212 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7bcd248a-77cd-448f-8396-4aed5c9f551f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:20.830694 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7bcd248a-77cd-448f-8396-4aed5c9f551f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:20.831119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7bcd248a-77cd-448f-8396-4aed5c9f551f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:20.831797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7bcd248a-77cd-448f-8396-4aed5c9f551f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:20.832243 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7bcd248a-77cd-448f-8396-4aed5c9f551f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:20.832687 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7bcd248a-77cd-448f-8396-4aed5c9f551f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:20.963746 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7bcd248a-77cd-448f-8396-4aed5c9f551f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:20.971439 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7bcd248a-77cd-448f-8396-4aed5c9f551f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1577 microversion: 2.1 time: 0.152579 Sep 26 05:35:20.972001 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 407/790] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:20 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:21.465204 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-66cd4c83-3010-41a8-a871-a01c61165001 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:21.465813 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-66cd4c83-3010-41a8-a871-a01c61165001 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:21.472148 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66cd4c83-3010-41a8-a871-a01c61165001 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:21.472669 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66cd4c83-3010-41a8-a871-a01c61165001 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:21.473099 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66cd4c83-3010-41a8-a871-a01c61165001 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:21.473777 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66cd4c83-3010-41a8-a871-a01c61165001 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:21.474327 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66cd4c83-3010-41a8-a871-a01c61165001 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:21.474783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66cd4c83-3010-41a8-a871-a01c61165001 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:21.544222 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-66cd4c83-3010-41a8-a871-a01c61165001 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:21.547195 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5a333be3-b5df-493b-b133-38e4ac4ada56 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:21.547914 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5a333be3-b5df-493b-b133-38e4ac4ada56 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:21.551901 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-66cd4c83-3010-41a8-a871-a01c61165001 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1331 microversion: 2.1 time: 0.090611 Sep 26 05:35:21.553027 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 384/791] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:21 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1331 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:21.554810 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5a333be3-b5df-493b-b133-38e4ac4ada56 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:21.555369 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5a333be3-b5df-493b-b133-38e4ac4ada56 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:21.555873 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5a333be3-b5df-493b-b133-38e4ac4ada56 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:21.556693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5a333be3-b5df-493b-b133-38e4ac4ada56 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:21.557217 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5a333be3-b5df-493b-b133-38e4ac4ada56 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:21.557713 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5a333be3-b5df-493b-b133-38e4ac4ada56 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:21.689723 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5a333be3-b5df-493b-b133-38e4ac4ada56 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:21.697582 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5a333be3-b5df-493b-b133-38e4ac4ada56 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 200 len: 1558 microversion: 2.1 time: 0.154328 Sep 26 05:35:21.698144 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 408/792] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:21 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:35:21.719695 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a63f574b-29a9-4b9c-9638-581094727488 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:21.720186 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a63f574b-29a9-4b9c-9638-581094727488 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:21.726826 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a63f574b-29a9-4b9c-9638-581094727488 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:21.727301 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a63f574b-29a9-4b9c-9638-581094727488 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:21.727733 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a63f574b-29a9-4b9c-9638-581094727488 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:21.728454 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a63f574b-29a9-4b9c-9638-581094727488 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:21.728898 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a63f574b-29a9-4b9c-9638-581094727488 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:21.729322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a63f574b-29a9-4b9c-9638-581094727488 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:21.804653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a63f574b-29a9-4b9c-9638-581094727488 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088719 Sep 26 05:35:21.805244 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 385/793] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 05:35:21 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:35:21.996690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-0c502c65-05ad-4498-9263-14ed4e7e8541 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:21.997338 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-0c502c65-05ad-4498-9263-14ed4e7e8541 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:22.003549 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c502c65-05ad-4498-9263-14ed4e7e8541 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:22.004064 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c502c65-05ad-4498-9263-14ed4e7e8541 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:22.004546 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c502c65-05ad-4498-9263-14ed4e7e8541 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:22.005413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c502c65-05ad-4498-9263-14ed4e7e8541 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:22.006012 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c502c65-05ad-4498-9263-14ed4e7e8541 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:22.006433 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c502c65-05ad-4498-9263-14ed4e7e8541 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:22.253611 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0c502c65-05ad-4498-9263-14ed4e7e8541 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:22.261701 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-0c502c65-05ad-4498-9263-14ed4e7e8541 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1577 microversion: 2.1 time: 0.268930 Sep 26 05:35:22.262268 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 409/794] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:21 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1577 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:22.579647 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-59bf77d2-7fcb-45d9-b4a0-74472e6a9d20 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:22.580285 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-59bf77d2-7fcb-45d9-b4a0-74472e6a9d20 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:22.596336 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59bf77d2-7fcb-45d9-b4a0-74472e6a9d20 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:22.596854 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59bf77d2-7fcb-45d9-b4a0-74472e6a9d20 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:22.597473 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59bf77d2-7fcb-45d9-b4a0-74472e6a9d20 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:22.598200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59bf77d2-7fcb-45d9-b4a0-74472e6a9d20 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:22.598716 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59bf77d2-7fcb-45d9-b4a0-74472e6a9d20 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:22.599363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59bf77d2-7fcb-45d9-b4a0-74472e6a9d20 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:22.634903 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59bf77d2-7fcb-45d9-b4a0-74472e6a9d20 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:22.635376 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59bf77d2-7fcb-45d9-b4a0-74472e6a9d20 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:22.635814 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59bf77d2-7fcb-45d9-b4a0-74472e6a9d20 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:22.636281 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-59bf77d2-7fcb-45d9-b4a0-74472e6a9d20 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lazy-loading 'fault' on Instance uuid 30c51093-517b-4a33-9d80-8bf0e1747e75 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:35:22.687311 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-59bf77d2-7fcb-45d9-b4a0-74472e6a9d20 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:22.695803 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-59bf77d2-7fcb-45d9-b4a0-74472e6a9d20 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1336 microversion: 2.1 time: 0.120748 Sep 26 05:35:22.708988 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 386/795] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:22 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1336 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:22.830776 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-fff745d3-6199-417e-8f88-bcad2b1f9f59 req-43f7190a-700b-41bb-8f15-b48a6aecd425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd42d52-e8d1-447f-882e-7151c7010c2d", "tag": "a50f5065-0980-4bdd-bcd4-888e4c8e6890"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:35:22.840567 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-fff745d3-6199-417e-8f88-bcad2b1f9f59 req-43f7190a-700b-41bb-8f15-b48a6aecd425 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:22.841036 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-fff745d3-6199-417e-8f88-bcad2b1f9f59 req-43f7190a-700b-41bb-8f15-b48a6aecd425 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:22.841490 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-fff745d3-6199-417e-8f88-bcad2b1f9f59 req-43f7190a-700b-41bb-8f15-b48a6aecd425 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:22.853813 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-fff745d3-6199-417e-8f88-bcad2b1f9f59 req-43f7190a-700b-41bb-8f15-b48a6aecd425 service nova] Creating event network-changed:a50f5065-0980-4bdd-bcd4-888e4c8e6890 for instance acd42d52-e8d1-447f-882e-7151c7010c2d on hv-cinder-85918 Sep 26 05:35:22.858667 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-fff745d3-6199-417e-8f88-bcad2b1f9f59 req-43f7190a-700b-41bb-8f15-b48a6aecd425 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031536 Sep 26 05:35:22.859470 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 410/796] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:35:23.285368 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2b60efc1-06c8-4fe5-ac9c-4c8cb57f5d67 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:23.285984 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2b60efc1-06c8-4fe5-ac9c-4c8cb57f5d67 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:23.292906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b60efc1-06c8-4fe5-ac9c-4c8cb57f5d67 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:23.293614 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b60efc1-06c8-4fe5-ac9c-4c8cb57f5d67 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:23.294054 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b60efc1-06c8-4fe5-ac9c-4c8cb57f5d67 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:23.294756 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b60efc1-06c8-4fe5-ac9c-4c8cb57f5d67 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:23.295215 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b60efc1-06c8-4fe5-ac9c-4c8cb57f5d67 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:23.295788 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b60efc1-06c8-4fe5-ac9c-4c8cb57f5d67 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:23.505684 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2b60efc1-06c8-4fe5-ac9c-4c8cb57f5d67 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:23.508313 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:23.516767 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2b60efc1-06c8-4fe5-ac9c-4c8cb57f5d67 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1564 microversion: 2.1 time: 0.234994 Sep 26 05:35:23.517758 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 387/797] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:23 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1564 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:23.721716 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-06015965-e43d-482c-9b69-25add2e0f4ae tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:23.722999 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-06015965-e43d-482c-9b69-25add2e0f4ae tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:23.730675 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-06015965-e43d-482c-9b69-25add2e0f4ae tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:23.731162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-06015965-e43d-482c-9b69-25add2e0f4ae tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:23.731787 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-06015965-e43d-482c-9b69-25add2e0f4ae tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:23.732513 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-06015965-e43d-482c-9b69-25add2e0f4ae tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:23.732966 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-06015965-e43d-482c-9b69-25add2e0f4ae tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:23.733444 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-06015965-e43d-482c-9b69-25add2e0f4ae tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:23.766272 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-06015965-e43d-482c-9b69-25add2e0f4ae tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:23.766859 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-06015965-e43d-482c-9b69-25add2e0f4ae tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:23.767370 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-06015965-e43d-482c-9b69-25add2e0f4ae tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:23.767895 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-06015965-e43d-482c-9b69-25add2e0f4ae tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lazy-loading 'fault' on Instance uuid 30c51093-517b-4a33-9d80-8bf0e1747e75 {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:35:23.825694 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-06015965-e43d-482c-9b69-25add2e0f4ae tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:23.834568 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-06015965-e43d-482c-9b69-25add2e0f4ae tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 200 len: 1336 microversion: 2.1 time: 0.117697 Sep 26 05:35:23.835674 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 411/798] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:23 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 1336 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:24.858393 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b683ff34-76c6-414c-8b8c-7dd0806334b2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:24.859004 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b683ff34-76c6-414c-8b8c-7dd0806334b2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 30c51093-517b-4a33-9d80-8bf0e1747e75] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:24.866818 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b683ff34-76c6-414c-8b8c-7dd0806334b2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:24.867306 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b683ff34-76c6-414c-8b8c-7dd0806334b2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:24.867750 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b683ff34-76c6-414c-8b8c-7dd0806334b2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:24.868471 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b683ff34-76c6-414c-8b8c-7dd0806334b2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:24.868930 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b683ff34-76c6-414c-8b8c-7dd0806334b2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:24.869356 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b683ff34-76c6-414c-8b8c-7dd0806334b2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:24.883644 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-b683ff34-76c6-414c-8b8c-7dd0806334b2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] HTTP exception thrown: Instance 30c51093-517b-4a33-9d80-8bf0e1747e75 could not be found. Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b683ff34-76c6-414c-8b8c-7dd0806334b2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Request method failure captured: Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 HTTP/1.1 Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTivBvtiLsDynVA2bAKI90oygZ30ioDR3YG_muA8Xt1hjZBfVOLnnIKeLoTKxZiO69-Ddx_DTOJh3FNG9fup9oSLVndq9WzArQ-VSQsJcXJKLTFn5mH1QcjR7BSlyztXNqEUpmqs3NzmftHVS2Zaxk0_x4Yll5AojazwDK2lCvQJ3as Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: 01c8f7766cb646b7b646a53c9de8e91a Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1282050550 Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:35:24.885328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:35:24.886941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01c8f7766cb646b7b646a53c9de8e91a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01c8f7766cb646b7b646a53c9de8e91a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01c8f7766cb646b7b646a53c9de8e91a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01c8f7766cb646b7b646a53c9de8e91a"}]}] Sep 26 05:35:24.886941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1282050550 Sep 26 05:35:24.886941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 01c8f7766cb646b7b646a53c9de8e91a Sep 26 05:35:24.886941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1282050550 Sep 26 05:35:24.886941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-ServerRescueNegativeTestJSON-1282050550-project Sep 26 05:35:24.886941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:35:24.886941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:35:24.886941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 683c4d41fa4a452ba8210e62dd43f7f4 Sep 26 05:35:24.886941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1282050550-project Sep 26 05:35:24.886941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:35:24.886941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance 30c51093-517b-4a33-9d80-8bf0e1747e75 could not be found. Sep 26 05:35:24.886941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': '30c51093-517b-4a33-9d80-8bf0e1747e75'} Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c51093-517b-4a33-9d80-8bf0e1747e75 could not be found. Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:35:24.887770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:35:24.888991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:35:24.888991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:35:24.888991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:35:24.888991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:35:24.888991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:35:24.888991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:35:24.888991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:35:24.888991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c51093-517b-4a33-9d80-8bf0e1747e75 could not be found. Sep 26 05:35:24.888991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:35:24.888991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:35:24.888991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:35:24.888991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:35:24.888991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:35:24.888991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:35:24.888991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:35:24.888991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:35:24.888991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c51093-517b-4a33-9d80-8bf0e1747e75 could not be found. Sep 26 05:35:24.888991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:35:24.890558 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b683ff34-76c6-414c-8b8c-7dd0806334b2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Returning 404 to user: Instance 30c51093-517b-4a33-9d80-8bf0e1747e75 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:35:24.890558 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b683ff34-76c6-414c-8b8c-7dd0806334b2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75" status: 404 len: 111 microversion: 2.1 time: 0.032584 Sep 26 05:35:24.890558 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 388/799] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:24 2022] GET /compute/v2.1/servers/30c51093-517b-4a33-9d80-8bf0e1747e75 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:35:24.895269 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c301d3f6-8c28-47cd-a706-b2cc969f7b29 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '.version_select at 0x7fd7b71e7550>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:24.915596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c301d3f6-8c28-47cd-a706-b2cc969f7b29 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1084361819" status: 202 len: 0 microversion: 2.1 time: 0.023977 Sep 26 05:35:24.916309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 412/800] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Sep 26 05:35:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1084361819 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:35:26.943842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-aba243a1-9dd9-44a6-b0dd-7c18dc7ec455 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:26.944354 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-aba243a1-9dd9-44a6-b0dd-7c18dc7ec455 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:26.950932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aba243a1-9dd9-44a6-b0dd-7c18dc7ec455 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:26.951419 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aba243a1-9dd9-44a6-b0dd-7c18dc7ec455 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:26.951856 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aba243a1-9dd9-44a6-b0dd-7c18dc7ec455 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:26.952581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aba243a1-9dd9-44a6-b0dd-7c18dc7ec455 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:26.953039 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aba243a1-9dd9-44a6-b0dd-7c18dc7ec455 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:26.953465 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aba243a1-9dd9-44a6-b0dd-7c18dc7ec455 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:26.977371 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-aba243a1-9dd9-44a6-b0dd-7c18dc7ec455 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e/ips" status: 200 len: 151 microversion: 2.20 time: 0.038223 Sep 26 05:35:26.977866 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 389/801] 10.222.0.49 () {60 vars in 1289 bytes} [Mon Sep 26 05:35:26 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:35:27.974926 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f1931544-6173-430a-921d-1b751b3d86e0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:27.975462 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f1931544-6173-430a-921d-1b751b3d86e0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:27.987129 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f1931544-6173-430a-921d-1b751b3d86e0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:27.987647 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f1931544-6173-430a-921d-1b751b3d86e0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:27.988080 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f1931544-6173-430a-921d-1b751b3d86e0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:27.988814 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f1931544-6173-430a-921d-1b751b3d86e0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:27.989300 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f1931544-6173-430a-921d-1b751b3d86e0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:27.989730 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f1931544-6173-430a-921d-1b751b3d86e0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:28.016385 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f1931544-6173-430a-921d-1b751b3d86e0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Going to try to terminate instance {{(pid=120806) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:35:28.091481 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f1931544-6173-430a-921d-1b751b3d86e0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 204 len: 0 microversion: 2.1 time: 0.120917 Sep 26 05:35:28.092074 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 413/802] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:35:27 2022] DELETE /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:35:28.100203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-792ecdfc-9e85-4bf3-9e6f-5082c22241cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:28.101694 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-792ecdfc-9e85-4bf3-9e6f-5082c22241cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:28.109365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-792ecdfc-9e85-4bf3-9e6f-5082c22241cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:28.109365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-792ecdfc-9e85-4bf3-9e6f-5082c22241cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:28.109365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-792ecdfc-9e85-4bf3-9e6f-5082c22241cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:28.109833 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-792ecdfc-9e85-4bf3-9e6f-5082c22241cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:28.110282 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-792ecdfc-9e85-4bf3-9e6f-5082c22241cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:28.110703 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-792ecdfc-9e85-4bf3-9e6f-5082c22241cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:28.237523 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-792ecdfc-9e85-4bf3-9e6f-5082c22241cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:28.245853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-792ecdfc-9e85-4bf3-9e6f-5082c22241cc tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1507 microversion: 2.1 time: 0.149636 Sep 26 05:35:28.246418 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 390/803] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:28 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:29.268548 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-2c4a898c-47f1-4424-b765-72ef89ed219d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:35:29.269175 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-2c4a898c-47f1-4424-b765-72ef89ed219d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:29.269284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d955e003-74c2-4f6d-9b5b-60616fa303fb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:29.269828 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d955e003-74c2-4f6d-9b5b-60616fa303fb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:29.276438 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2c4a898c-47f1-4424-b765-72ef89ed219d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:29.276820 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d955e003-74c2-4f6d-9b5b-60616fa303fb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:29.276935 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2c4a898c-47f1-4424-b765-72ef89ed219d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:29.277297 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d955e003-74c2-4f6d-9b5b-60616fa303fb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:29.277415 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2c4a898c-47f1-4424-b765-72ef89ed219d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:29.277727 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d955e003-74c2-4f6d-9b5b-60616fa303fb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:29.278023 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2c4a898c-47f1-4424-b765-72ef89ed219d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:29.278411 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d955e003-74c2-4f6d-9b5b-60616fa303fb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:29.278525 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2c4a898c-47f1-4424-b765-72ef89ed219d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:29.278856 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d955e003-74c2-4f6d-9b5b-60616fa303fb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:29.278973 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2c4a898c-47f1-4424-b765-72ef89ed219d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:29.279275 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d955e003-74c2-4f6d-9b5b-60616fa303fb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:29.301652 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-2c4a898c-47f1-4424-b765-72ef89ed219d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lazy-loading 'flavor' on Instance uuid e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:35:29.409634 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d955e003-74c2-4f6d-9b5b-60616fa303fb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:29.418570 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d955e003-74c2-4f6d-9b5b-60616fa303fb tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1507 microversion: 2.1 time: 0.153410 Sep 26 05:35:29.419123 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 391/804] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:29 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:35:29.504316 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2c4a898c-47f1-4424-b765-72ef89ed219d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "POST /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e/action" status: 202 len: 0 microversion: 2.20 time: 0.239800 Sep 26 05:35:29.504912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 414/805] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Sep 26 05:35:29 2022] POST /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:35:29.513436 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5f18f914-cada-4939-8038-c4ad27fc0082 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:29.514050 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5f18f914-cada-4939-8038-c4ad27fc0082 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:29.521494 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f18f914-cada-4939-8038-c4ad27fc0082 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:29.521910 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f18f914-cada-4939-8038-c4ad27fc0082 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:29.522343 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f18f914-cada-4939-8038-c4ad27fc0082 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:29.523024 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f18f914-cada-4939-8038-c4ad27fc0082 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:29.523474 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f18f914-cada-4939-8038-c4ad27fc0082 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:29.523890 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f18f914-cada-4939-8038-c4ad27fc0082 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:29.657920 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5f18f914-cada-4939-8038-c4ad27fc0082 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:29.667107 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5f18f914-cada-4939-8038-c4ad27fc0082 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:29.668568 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5f18f914-cada-4939-8038-c4ad27fc0082 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:29.669710 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5f18f914-cada-4939-8038-c4ad27fc0082 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.160461 Sep 26 05:35:29.670523 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 392/806] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:29 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:30.443463 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-699edeb3-9a5a-4bda-866c-ad361a403b4e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:30.444970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-699edeb3-9a5a-4bda-866c-ad361a403b4e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:30.453997 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-699edeb3-9a5a-4bda-866c-ad361a403b4e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:30.454500 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-699edeb3-9a5a-4bda-866c-ad361a403b4e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:30.454941 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-699edeb3-9a5a-4bda-866c-ad361a403b4e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:30.455648 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-699edeb3-9a5a-4bda-866c-ad361a403b4e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:30.456323 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-699edeb3-9a5a-4bda-866c-ad361a403b4e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:30.456926 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-699edeb3-9a5a-4bda-866c-ad361a403b4e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:30.488173 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-6aac11c5-5684-4a14-8715-2bce00f7f538 req-1f801a59-5375-48b2-a5e8-1ca1f0527ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6937727-fb89-499b-91ea-fa6b399607f7", "name": "network-vif-deleted", "tag": "38b128ed-e00f-4c9c-93fb-be3a153d50bf"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:35:30.515181 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-6aac11c5-5684-4a14-8715-2bce00f7f538 req-1f801a59-5375-48b2-a5e8-1ca1f0527ef1 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:30.515712 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-6aac11c5-5684-4a14-8715-2bce00f7f538 req-1f801a59-5375-48b2-a5e8-1ca1f0527ef1 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:30.516314 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-6aac11c5-5684-4a14-8715-2bce00f7f538 req-1f801a59-5375-48b2-a5e8-1ca1f0527ef1 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:30.533503 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-6aac11c5-5684-4a14-8715-2bce00f7f538 req-1f801a59-5375-48b2-a5e8-1ca1f0527ef1 service nova] Creating event network-vif-deleted:38b128ed-e00f-4c9c-93fb-be3a153d50bf for instance e6937727-fb89-499b-91ea-fa6b399607f7 on hv-cinder-85918 Sep 26 05:35:30.538787 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-6aac11c5-5684-4a14-8715-2bce00f7f538 req-1f801a59-5375-48b2-a5e8-1ca1f0527ef1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054365 Sep 26 05:35:30.539482 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 393/807] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:35:30.550778 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-699edeb3-9a5a-4bda-866c-ad361a403b4e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:30.559637 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-699edeb3-9a5a-4bda-866c-ad361a403b4e tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 200 len: 1465 microversion: 2.1 time: 0.121188 Sep 26 05:35:30.560782 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 415/808] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:30 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 1465 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:30.696391 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7d3f7494-6c8e-49c8-80de-7f0b91672986 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:30.697088 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7d3f7494-6c8e-49c8-80de-7f0b91672986 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:30.703248 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d3f7494-6c8e-49c8-80de-7f0b91672986 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:30.703932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d3f7494-6c8e-49c8-80de-7f0b91672986 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:30.704390 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d3f7494-6c8e-49c8-80de-7f0b91672986 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:30.705835 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d3f7494-6c8e-49c8-80de-7f0b91672986 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:30.706290 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d3f7494-6c8e-49c8-80de-7f0b91672986 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:30.706718 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d3f7494-6c8e-49c8-80de-7f0b91672986 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:30.851948 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7d3f7494-6c8e-49c8-80de-7f0b91672986 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:30.861359 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7d3f7494-6c8e-49c8-80de-7f0b91672986 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:30.862859 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7d3f7494-6c8e-49c8-80de-7f0b91672986 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:30.864136 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7d3f7494-6c8e-49c8-80de-7f0b91672986 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.172900 Sep 26 05:35:30.865092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 394/809] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:30 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:31.583846 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-861b4c6c-db6f-4207-ab35-a401cd2cfde2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:31.584500 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-861b4c6c-db6f-4207-ab35-a401cd2cfde2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: e6937727-fb89-499b-91ea-fa6b399607f7] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:31.591137 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-861b4c6c-db6f-4207-ab35-a401cd2cfde2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:31.591617 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-861b4c6c-db6f-4207-ab35-a401cd2cfde2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:31.592054 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-861b4c6c-db6f-4207-ab35-a401cd2cfde2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:31.592762 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-861b4c6c-db6f-4207-ab35-a401cd2cfde2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:31.593213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-861b4c6c-db6f-4207-ab35-a401cd2cfde2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:31.593661 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-861b4c6c-db6f-4207-ab35-a401cd2cfde2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:31.609665 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-861b4c6c-db6f-4207-ab35-a401cd2cfde2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] HTTP exception thrown: Instance e6937727-fb89-499b-91ea-fa6b399607f7 could not be found. Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-861b4c6c-db6f-4207-ab35-a401cd2cfde2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Request method failure captured: Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 HTTP/1.1 Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTivBvtiLsDynVA2bAKI90oygZ30ioDR3YG_muA8Xt1hjZBfVOLnnIKeLoTKxZiO69-Ddx_DTOJh3FNG9fup9oSLVndq9WzArQ-VSQsJcXJKLTFn5mH1QcjR7BSlyztXNqEUpmqs3NzmftHVS2Zaxk0_x4Yll5AojazwDK2lCvQJ3as Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: 01c8f7766cb646b7b646a53c9de8e91a Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1282050550 Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:35:31.611291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:35:31.612937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01c8f7766cb646b7b646a53c9de8e91a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01c8f7766cb646b7b646a53c9de8e91a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01c8f7766cb646b7b646a53c9de8e91a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01c8f7766cb646b7b646a53c9de8e91a"}]}] Sep 26 05:35:31.612937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1282050550 Sep 26 05:35:31.612937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: 01c8f7766cb646b7b646a53c9de8e91a Sep 26 05:35:31.612937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1282050550 Sep 26 05:35:31.612937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-ServerRescueNegativeTestJSON-1282050550-project Sep 26 05:35:31.612937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:35:31.612937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:35:31.612937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 683c4d41fa4a452ba8210e62dd43f7f4 Sep 26 05:35:31.612937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1282050550-project Sep 26 05:35:31.612937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:35:31.612937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance e6937727-fb89-499b-91ea-fa6b399607f7 could not be found. Sep 26 05:35:31.612937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': 'e6937727-fb89-499b-91ea-fa6b399607f7'} Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6937727-fb89-499b-91ea-fa6b399607f7 could not be found. Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:35:31.613850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:35:31.616049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:35:31.616049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:35:31.616049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:35:31.616049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:35:31.616049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:35:31.616049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:35:31.616049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:35:31.616049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6937727-fb89-499b-91ea-fa6b399607f7 could not be found. Sep 26 05:35:31.616049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:35:31.616049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:35:31.616049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:35:31.616049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:35:31.616049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:35:31.616049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:35:31.616049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:35:31.616049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:35:31.616049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6937727-fb89-499b-91ea-fa6b399607f7 could not be found. Sep 26 05:35:31.616049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:35:31.617562 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-861b4c6c-db6f-4207-ab35-a401cd2cfde2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Returning 404 to user: Instance e6937727-fb89-499b-91ea-fa6b399607f7 could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:35:31.617562 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-861b4c6c-db6f-4207-ab35-a401cd2cfde2 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7" status: 404 len: 111 microversion: 2.1 time: 0.033152 Sep 26 05:35:31.617562 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 416/810] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:31 2022] GET /compute/v2.1/servers/e6937727-fb89-499b-91ea-fa6b399607f7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:35:31.621933 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-88b6e322-69e6-468d-b181-d56310a4b7c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:31.622490 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-88b6e322-69e6-468d-b181-d56310a4b7c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:31.628912 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-88b6e322-69e6-468d-b181-d56310a4b7c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:31.629387 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-88b6e322-69e6-468d-b181-d56310a4b7c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:31.629844 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-88b6e322-69e6-468d-b181-d56310a4b7c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:31.630562 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-88b6e322-69e6-468d-b181-d56310a4b7c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:31.631009 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-88b6e322-69e6-468d-b181-d56310a4b7c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:31.631431 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-88b6e322-69e6-468d-b181-d56310a4b7c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:31.655902 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-88b6e322-69e6-468d-b181-d56310a4b7c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Going to try to terminate instance {{(pid=120805) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:35:31.731025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-88b6e322-69e6-468d-b181-d56310a4b7c0 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "DELETE /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 204 len: 0 microversion: 2.1 time: 0.112574 Sep 26 05:35:31.731624 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 395/811] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:35:31 2022] DELETE /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:35:31.740441 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a363f37f-1a55-46d0-a7a8-8bddbc977695 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:31.741120 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a363f37f-1a55-46d0-a7a8-8bddbc977695 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:31.747767 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a363f37f-1a55-46d0-a7a8-8bddbc977695 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:31.748386 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a363f37f-1a55-46d0-a7a8-8bddbc977695 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:31.748827 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a363f37f-1a55-46d0-a7a8-8bddbc977695 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:31.749530 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a363f37f-1a55-46d0-a7a8-8bddbc977695 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:31.749976 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a363f37f-1a55-46d0-a7a8-8bddbc977695 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:31.750400 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a363f37f-1a55-46d0-a7a8-8bddbc977695 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:31.877878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a363f37f-1a55-46d0-a7a8-8bddbc977695 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:31.885996 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a363f37f-1a55-46d0-a7a8-8bddbc977695 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.150051 Sep 26 05:35:31.886555 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 417/812] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:31 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:31.891626 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-be3e37b4-07d6-485d-b248-4726871a65d2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:31.892359 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-be3e37b4-07d6-485d-b248-4726871a65d2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:31.898938 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-be3e37b4-07d6-485d-b248-4726871a65d2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:31.899489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-be3e37b4-07d6-485d-b248-4726871a65d2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:31.899989 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-be3e37b4-07d6-485d-b248-4726871a65d2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:31.900788 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-be3e37b4-07d6-485d-b248-4726871a65d2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:31.901312 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-be3e37b4-07d6-485d-b248-4726871a65d2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:31.901791 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-be3e37b4-07d6-485d-b248-4726871a65d2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:32.034541 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-be3e37b4-07d6-485d-b248-4726871a65d2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:32.043430 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-be3e37b4-07d6-485d-b248-4726871a65d2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:32.044910 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-be3e37b4-07d6-485d-b248-4726871a65d2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:32.046062 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-be3e37b4-07d6-485d-b248-4726871a65d2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.158685 Sep 26 05:35:32.046617 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 396/813] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:31 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:35:32.909732 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5b9a5dc4-a5e4-477b-9a6e-1da140e512d5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:32.912102 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5b9a5dc4-a5e4-477b-9a6e-1da140e512d5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:32.918901 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5b9a5dc4-a5e4-477b-9a6e-1da140e512d5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:32.919382 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5b9a5dc4-a5e4-477b-9a6e-1da140e512d5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:32.919821 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5b9a5dc4-a5e4-477b-9a6e-1da140e512d5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:32.920542 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5b9a5dc4-a5e4-477b-9a6e-1da140e512d5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:32.920996 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5b9a5dc4-a5e4-477b-9a6e-1da140e512d5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:32.921421 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5b9a5dc4-a5e4-477b-9a6e-1da140e512d5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:33.049773 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5b9a5dc4-a5e4-477b-9a6e-1da140e512d5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:33.058281 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5b9a5dc4-a5e4-477b-9a6e-1da140e512d5 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.152469 Sep 26 05:35:33.058843 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 418/814] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:32 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:33.071027 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a10e3c2a-ad07-4223-8ec7-199343eedc49 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:33.071642 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a10e3c2a-ad07-4223-8ec7-199343eedc49 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:33.078067 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a10e3c2a-ad07-4223-8ec7-199343eedc49 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:33.078556 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a10e3c2a-ad07-4223-8ec7-199343eedc49 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:33.078993 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a10e3c2a-ad07-4223-8ec7-199343eedc49 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:33.079680 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a10e3c2a-ad07-4223-8ec7-199343eedc49 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:33.080134 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a10e3c2a-ad07-4223-8ec7-199343eedc49 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:33.080585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a10e3c2a-ad07-4223-8ec7-199343eedc49 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:33.208852 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a10e3c2a-ad07-4223-8ec7-199343eedc49 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:33.216773 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a10e3c2a-ad07-4223-8ec7-199343eedc49 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:33.218206 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a10e3c2a-ad07-4223-8ec7-199343eedc49 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:33.219346 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a10e3c2a-ad07-4223-8ec7-199343eedc49 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.152187 Sep 26 05:35:33.219909 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 397/815] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:33 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:34.080849 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-38e6018e-b7bb-4762-8fe9-8e826a6eb0c6 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:34.081566 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-38e6018e-b7bb-4762-8fe9-8e826a6eb0c6 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:34.089682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-38e6018e-b7bb-4762-8fe9-8e826a6eb0c6 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:34.090170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-38e6018e-b7bb-4762-8fe9-8e826a6eb0c6 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:34.090609 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-38e6018e-b7bb-4762-8fe9-8e826a6eb0c6 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:34.091308 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-38e6018e-b7bb-4762-8fe9-8e826a6eb0c6 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:34.091769 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-38e6018e-b7bb-4762-8fe9-8e826a6eb0c6 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:34.092197 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-38e6018e-b7bb-4762-8fe9-8e826a6eb0c6 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:34.218622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-38e6018e-b7bb-4762-8fe9-8e826a6eb0c6 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:34.226670 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-38e6018e-b7bb-4762-8fe9-8e826a6eb0c6 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.149718 Sep 26 05:35:34.227233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 419/816] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:34 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:34.245473 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d383de88-5e17-4024-b9a1-165ca9095359 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:34.246107 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d383de88-5e17-4024-b9a1-165ca9095359 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:34.252438 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d383de88-5e17-4024-b9a1-165ca9095359 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:34.252916 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d383de88-5e17-4024-b9a1-165ca9095359 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:34.253345 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d383de88-5e17-4024-b9a1-165ca9095359 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:34.254023 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d383de88-5e17-4024-b9a1-165ca9095359 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:34.255416 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d383de88-5e17-4024-b9a1-165ca9095359 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:34.255852 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d383de88-5e17-4024-b9a1-165ca9095359 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:34.383575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d383de88-5e17-4024-b9a1-165ca9095359 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:34.391618 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d383de88-5e17-4024-b9a1-165ca9095359 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:34.393100 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d383de88-5e17-4024-b9a1-165ca9095359 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:34.394248 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d383de88-5e17-4024-b9a1-165ca9095359 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.152682 Sep 26 05:35:34.394809 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 398/817] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:34 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:35.250045 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5a7a6db4-6dc9-4c14-8f80-32f3fbb12700 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:35.250730 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5a7a6db4-6dc9-4c14-8f80-32f3fbb12700 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:35.256922 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5a7a6db4-6dc9-4c14-8f80-32f3fbb12700 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:35.257397 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5a7a6db4-6dc9-4c14-8f80-32f3fbb12700 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:35.257823 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5a7a6db4-6dc9-4c14-8f80-32f3fbb12700 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:35.258505 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5a7a6db4-6dc9-4c14-8f80-32f3fbb12700 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:35.258950 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5a7a6db4-6dc9-4c14-8f80-32f3fbb12700 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:35.259369 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5a7a6db4-6dc9-4c14-8f80-32f3fbb12700 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:35.418900 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a96bb0d8-a566-47bb-a481-c44dc480a3a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:35.419503 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a96bb0d8-a566-47bb-a481-c44dc480a3a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:35.425888 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a96bb0d8-a566-47bb-a481-c44dc480a3a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:35.426962 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a96bb0d8-a566-47bb-a481-c44dc480a3a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:35.427582 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a96bb0d8-a566-47bb-a481-c44dc480a3a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:35.428355 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a96bb0d8-a566-47bb-a481-c44dc480a3a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:35.428759 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a96bb0d8-a566-47bb-a481-c44dc480a3a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:35.429183 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a96bb0d8-a566-47bb-a481-c44dc480a3a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:35.510574 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5a7a6db4-6dc9-4c14-8f80-32f3fbb12700 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:35.514035 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:35.519088 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5a7a6db4-6dc9-4c14-8f80-32f3fbb12700 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1521 microversion: 2.1 time: 0.273084 Sep 26 05:35:35.520214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 420/818] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:35 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:35.638992 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a96bb0d8-a566-47bb-a481-c44dc480a3a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:35.650991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a96bb0d8-a566-47bb-a481-c44dc480a3a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:35.650991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a96bb0d8-a566-47bb-a481-c44dc480a3a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:35.650991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a96bb0d8-a566-47bb-a481-c44dc480a3a0 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.235775 Sep 26 05:35:35.651756 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 399/819] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:35 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:35:35.807723 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-5a59e89d-cf92-48e1-bf40-1d35c7d400b0 req-07367515-d392-4f45-bf02-7ff7baa22921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01274a67-17fb-45e3-9f2a-6a718b15b902", "name": "network-vif-deleted", "tag": "f70e6461-7f87-4ee4-b3e4-f7d4db390598"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:35:35.818772 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-5a59e89d-cf92-48e1-bf40-1d35c7d400b0 req-07367515-d392-4f45-bf02-7ff7baa22921 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:35.819240 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-5a59e89d-cf92-48e1-bf40-1d35c7d400b0 req-07367515-d392-4f45-bf02-7ff7baa22921 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:35.819662 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-5a59e89d-cf92-48e1-bf40-1d35c7d400b0 req-07367515-d392-4f45-bf02-7ff7baa22921 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:35.831240 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-5a59e89d-cf92-48e1-bf40-1d35c7d400b0 req-07367515-d392-4f45-bf02-7ff7baa22921 service nova] Creating event network-vif-deleted:f70e6461-7f87-4ee4-b3e4-f7d4db390598 for instance 01274a67-17fb-45e3-9f2a-6a718b15b902 on hv-cinder-85918 Sep 26 05:35:35.836733 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-5a59e89d-cf92-48e1-bf40-1d35c7d400b0 req-07367515-d392-4f45-bf02-7ff7baa22921 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032573 Sep 26 05:35:35.837322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 421/820] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:35:36.542592 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ead4bf7b-be3d-40c5-be74-3a2630c4e32c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:36.543353 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ead4bf7b-be3d-40c5-be74-3a2630c4e32c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:36.550932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ead4bf7b-be3d-40c5-be74-3a2630c4e32c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:36.551912 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ead4bf7b-be3d-40c5-be74-3a2630c4e32c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:36.552822 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ead4bf7b-be3d-40c5-be74-3a2630c4e32c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:36.553300 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ead4bf7b-be3d-40c5-be74-3a2630c4e32c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:36.553817 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ead4bf7b-be3d-40c5-be74-3a2630c4e32c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:36.554185 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ead4bf7b-be3d-40c5-be74-3a2630c4e32c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:36.590297 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ead4bf7b-be3d-40c5-be74-3a2630c4e32c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:36.590776 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ead4bf7b-be3d-40c5-be74-3a2630c4e32c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:36.591211 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ead4bf7b-be3d-40c5-be74-3a2630c4e32c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:36.591658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-ead4bf7b-be3d-40c5-be74-3a2630c4e32c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lazy-loading 'fault' on Instance uuid 01274a67-17fb-45e3-9f2a-6a718b15b902 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:35:36.634316 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ead4bf7b-be3d-40c5-be74-3a2630c4e32c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c4d41fa4a452ba8210e62dd43f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c8f7766cb646b7b646a53c9de8e91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:36.642170 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ead4bf7b-be3d-40c5-be74-3a2630c4e32c tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 200 len: 1312 microversion: 2.1 time: 0.103535 Sep 26 05:35:36.642742 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 400/821] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:36 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:36.678427 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-8b9d8430-4984-443d-80df-f9eaa177a61e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:36.679150 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-8b9d8430-4984-443d-80df-f9eaa177a61e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:36.685247 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8b9d8430-4984-443d-80df-f9eaa177a61e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:36.685717 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8b9d8430-4984-443d-80df-f9eaa177a61e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:36.686140 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8b9d8430-4984-443d-80df-f9eaa177a61e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:36.686820 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8b9d8430-4984-443d-80df-f9eaa177a61e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:36.687263 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8b9d8430-4984-443d-80df-f9eaa177a61e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:36.687681 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8b9d8430-4984-443d-80df-f9eaa177a61e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:36.816917 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8b9d8430-4984-443d-80df-f9eaa177a61e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:36.824939 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8b9d8430-4984-443d-80df-f9eaa177a61e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:36.826384 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8b9d8430-4984-443d-80df-f9eaa177a61e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:36.827526 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-8b9d8430-4984-443d-80df-f9eaa177a61e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.154537 Sep 26 05:35:36.828082 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 422/822] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:36 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:37.665993 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b96bfb99-1ef6-4c6a-960d-981cb238a566 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:37.666605 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b96bfb99-1ef6-4c6a-960d-981cb238a566 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] [instance: 01274a67-17fb-45e3-9f2a-6a718b15b902] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:37.673153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b96bfb99-1ef6-4c6a-960d-981cb238a566 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:37.673635 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b96bfb99-1ef6-4c6a-960d-981cb238a566 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:37.674076 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b96bfb99-1ef6-4c6a-960d-981cb238a566 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:37.674756 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b96bfb99-1ef6-4c6a-960d-981cb238a566 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:37.675205 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b96bfb99-1ef6-4c6a-960d-981cb238a566 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:37.675624 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b96bfb99-1ef6-4c6a-960d-981cb238a566 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:37.688902 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-b96bfb99-1ef6-4c6a-960d-981cb238a566 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] HTTP exception thrown: Instance 01274a67-17fb-45e3-9f2a-6a718b15b902 could not be found. Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b96bfb99-1ef6-4c6a-960d-981cb238a566 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Request method failure captured: Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 HTTP/1.1 Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTivBvtiLsDynVA2bAKI90oygZ30ioDR3YG_muA8Xt1hjZBfVOLnnIKeLoTKxZiO69-Ddx_DTOJh3FNG9fup9oSLVndq9WzArQ-VSQsJcXJKLTFn5mH1QcjR7BSlyztXNqEUpmqs3NzmftHVS2Zaxk0_x4Yll5AojazwDK2lCvQJ3as Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: 01c8f7766cb646b7b646a53c9de8e91a Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1282050550 Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:35:37.690539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:35:37.692853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01c8f7766cb646b7b646a53c9de8e91a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01c8f7766cb646b7b646a53c9de8e91a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01c8f7766cb646b7b646a53c9de8e91a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01c8f7766cb646b7b646a53c9de8e91a"}]}] Sep 26 05:35:37.692853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1282050550 Sep 26 05:35:37.692853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 01c8f7766cb646b7b646a53c9de8e91a Sep 26 05:35:37.692853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1282050550 Sep 26 05:35:37.692853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-ServerRescueNegativeTestJSON-1282050550-project Sep 26 05:35:37.692853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:35:37.692853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:35:37.692853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 683c4d41fa4a452ba8210e62dd43f7f4 Sep 26 05:35:37.692853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1282050550-project Sep 26 05:35:37.692853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:35:37.692853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance 01274a67-17fb-45e3-9f2a-6a718b15b902 could not be found. Sep 26 05:35:37.692853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': '01274a67-17fb-45e3-9f2a-6a718b15b902'} Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01274a67-17fb-45e3-9f2a-6a718b15b902 could not be found. Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:35:37.693783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:35:37.694985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:35:37.694985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:35:37.694985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:35:37.694985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:35:37.694985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:35:37.694985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:35:37.694985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:35:37.694985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01274a67-17fb-45e3-9f2a-6a718b15b902 could not be found. Sep 26 05:35:37.694985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:35:37.694985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:35:37.694985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:35:37.694985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:35:37.694985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:35:37.694985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:35:37.694985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:35:37.694985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:35:37.694985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01274a67-17fb-45e3-9f2a-6a718b15b902 could not be found. Sep 26 05:35:37.694985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:35:37.696199 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b96bfb99-1ef6-4c6a-960d-981cb238a566 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] Returning 404 to user: Instance 01274a67-17fb-45e3-9f2a-6a718b15b902 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:35:37.696199 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b96bfb99-1ef6-4c6a-960d-981cb238a566 tempest-ServerRescueNegativeTestJSON-1282050550 tempest-ServerRescueNegativeTestJSON-1282050550-project] 10.222.0.49 "GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902" status: 404 len: 111 microversion: 2.1 time: 0.029854 Sep 26 05:35:37.696199 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 401/823] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:37 2022] GET /compute/v2.1/servers/01274a67-17fb-45e3-9f2a-6a718b15b902 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:35:37.853691 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-8f8bd626-0e3c-4525-9710-3eda8229e9aa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:37.854301 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-8f8bd626-0e3c-4525-9710-3eda8229e9aa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:37.857349 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:37.862478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8f8bd626-0e3c-4525-9710-3eda8229e9aa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:37.862954 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8f8bd626-0e3c-4525-9710-3eda8229e9aa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:37.863383 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8f8bd626-0e3c-4525-9710-3eda8229e9aa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:37.864866 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8f8bd626-0e3c-4525-9710-3eda8229e9aa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:37.865336 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8f8bd626-0e3c-4525-9710-3eda8229e9aa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:37.865751 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8f8bd626-0e3c-4525-9710-3eda8229e9aa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:38.105511 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8f8bd626-0e3c-4525-9710-3eda8229e9aa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:38.118594 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8f8bd626-0e3c-4525-9710-3eda8229e9aa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:38.119268 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8f8bd626-0e3c-4525-9710-3eda8229e9aa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:38.120466 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-8f8bd626-0e3c-4525-9710-3eda8229e9aa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.271056 Sep 26 05:35:38.121013 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 423/824] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:37 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:39.147015 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cc079e18-8e54-4e5f-aa07-d9f486a52baa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:39.147716 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cc079e18-8e54-4e5f-aa07-d9f486a52baa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:39.150249 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:39.155605 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cc079e18-8e54-4e5f-aa07-d9f486a52baa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:39.156167 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cc079e18-8e54-4e5f-aa07-d9f486a52baa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:39.156642 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cc079e18-8e54-4e5f-aa07-d9f486a52baa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:39.157372 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cc079e18-8e54-4e5f-aa07-d9f486a52baa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:39.157833 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cc079e18-8e54-4e5f-aa07-d9f486a52baa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:39.158262 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cc079e18-8e54-4e5f-aa07-d9f486a52baa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:39.404575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cc079e18-8e54-4e5f-aa07-d9f486a52baa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:39.413405 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cc079e18-8e54-4e5f-aa07-d9f486a52baa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:39.414839 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cc079e18-8e54-4e5f-aa07-d9f486a52baa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:39.415985 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cc079e18-8e54-4e5f-aa07-d9f486a52baa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.273377 Sep 26 05:35:39.416564 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 402/825] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:39 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:40.441142 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-34bb1fa2-f286-4adf-b1da-7050235e8458 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:40.442801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-34bb1fa2-f286-4adf-b1da-7050235e8458 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:40.448994 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-34bb1fa2-f286-4adf-b1da-7050235e8458 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:40.449554 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-34bb1fa2-f286-4adf-b1da-7050235e8458 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:40.449996 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-34bb1fa2-f286-4adf-b1da-7050235e8458 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:40.450692 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-34bb1fa2-f286-4adf-b1da-7050235e8458 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:40.451147 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-34bb1fa2-f286-4adf-b1da-7050235e8458 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:40.451574 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-34bb1fa2-f286-4adf-b1da-7050235e8458 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:40.640626 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-34bb1fa2-f286-4adf-b1da-7050235e8458 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:40.651139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-34bb1fa2-f286-4adf-b1da-7050235e8458 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:40.652650 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-34bb1fa2-f286-4adf-b1da-7050235e8458 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:40.653837 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-34bb1fa2-f286-4adf-b1da-7050235e8458 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.216554 Sep 26 05:35:40.654409 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 424/826] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:40 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:41.681085 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cd9c04b5-1b4d-4968-bd87-299fa41d1ccc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:41.681718 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cd9c04b5-1b4d-4968-bd87-299fa41d1ccc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:41.688566 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cd9c04b5-1b4d-4968-bd87-299fa41d1ccc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:41.689045 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cd9c04b5-1b4d-4968-bd87-299fa41d1ccc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:41.689484 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cd9c04b5-1b4d-4968-bd87-299fa41d1ccc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:41.690162 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cd9c04b5-1b4d-4968-bd87-299fa41d1ccc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:41.690619 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cd9c04b5-1b4d-4968-bd87-299fa41d1ccc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:41.691038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cd9c04b5-1b4d-4968-bd87-299fa41d1ccc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:41.826906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cd9c04b5-1b4d-4968-bd87-299fa41d1ccc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:41.835598 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cd9c04b5-1b4d-4968-bd87-299fa41d1ccc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:41.837248 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cd9c04b5-1b4d-4968-bd87-299fa41d1ccc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:41.838199 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cd9c04b5-1b4d-4968-bd87-299fa41d1ccc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.160995 Sep 26 05:35:41.838922 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 403/827] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:41 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:42.865656 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6d3a4e1b-2f4b-4201-a78e-49ad7cca1195 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:42.866275 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6d3a4e1b-2f4b-4201-a78e-49ad7cca1195 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:42.873242 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6d3a4e1b-2f4b-4201-a78e-49ad7cca1195 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:42.873842 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6d3a4e1b-2f4b-4201-a78e-49ad7cca1195 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:42.874289 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6d3a4e1b-2f4b-4201-a78e-49ad7cca1195 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:42.874979 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6d3a4e1b-2f4b-4201-a78e-49ad7cca1195 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:42.875428 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6d3a4e1b-2f4b-4201-a78e-49ad7cca1195 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:42.875844 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6d3a4e1b-2f4b-4201-a78e-49ad7cca1195 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:43.010879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6d3a4e1b-2f4b-4201-a78e-49ad7cca1195 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:43.019361 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6d3a4e1b-2f4b-4201-a78e-49ad7cca1195 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:43.021712 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6d3a4e1b-2f4b-4201-a78e-49ad7cca1195 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:43.022878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6d3a4e1b-2f4b-4201-a78e-49ad7cca1195 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.161096 Sep 26 05:35:43.023442 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 425/828] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:42 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:44.049474 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8197a8c2-f47b-421d-869d-fcd535791ee2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:44.051468 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8197a8c2-f47b-421d-869d-fcd535791ee2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:44.060356 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8197a8c2-f47b-421d-869d-fcd535791ee2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:44.060839 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8197a8c2-f47b-421d-869d-fcd535791ee2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:44.061273 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8197a8c2-f47b-421d-869d-fcd535791ee2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:44.061962 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8197a8c2-f47b-421d-869d-fcd535791ee2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:44.062414 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8197a8c2-f47b-421d-869d-fcd535791ee2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:44.062833 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8197a8c2-f47b-421d-869d-fcd535791ee2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:44.193843 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8197a8c2-f47b-421d-869d-fcd535791ee2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:44.195998 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:44.203605 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8197a8c2-f47b-421d-869d-fcd535791ee2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:44.205079 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8197a8c2-f47b-421d-869d-fcd535791ee2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:44.206203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8197a8c2-f47b-421d-869d-fcd535791ee2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.161760 Sep 26 05:35:44.206749 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 404/829] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:44 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:45.232185 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e7833060-2e1d-41e9-bae5-a2dfa7ee56ec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:45.232827 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e7833060-2e1d-41e9-bae5-a2dfa7ee56ec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:45.239259 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e7833060-2e1d-41e9-bae5-a2dfa7ee56ec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:45.239743 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e7833060-2e1d-41e9-bae5-a2dfa7ee56ec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:45.240177 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e7833060-2e1d-41e9-bae5-a2dfa7ee56ec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:45.240898 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e7833060-2e1d-41e9-bae5-a2dfa7ee56ec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:45.241345 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e7833060-2e1d-41e9-bae5-a2dfa7ee56ec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:45.241769 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e7833060-2e1d-41e9-bae5-a2dfa7ee56ec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:45.371211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e7833060-2e1d-41e9-bae5-a2dfa7ee56ec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:45.384442 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e7833060-2e1d-41e9-bae5-a2dfa7ee56ec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:45.385920 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e7833060-2e1d-41e9-bae5-a2dfa7ee56ec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:45.387076 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e7833060-2e1d-41e9-bae5-a2dfa7ee56ec tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.158825 Sep 26 05:35:45.387636 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 426/830] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:45 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:46.413297 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5e7a496a-f04a-4cd9-aeb1-e50e281cd8d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:46.413865 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5e7a496a-f04a-4cd9-aeb1-e50e281cd8d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:46.421448 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e7a496a-f04a-4cd9-aeb1-e50e281cd8d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:46.421926 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e7a496a-f04a-4cd9-aeb1-e50e281cd8d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:46.422378 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e7a496a-f04a-4cd9-aeb1-e50e281cd8d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:46.423092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e7a496a-f04a-4cd9-aeb1-e50e281cd8d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:46.423540 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e7a496a-f04a-4cd9-aeb1-e50e281cd8d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:46.423961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e7a496a-f04a-4cd9-aeb1-e50e281cd8d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:46.554964 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5e7a496a-f04a-4cd9-aeb1-e50e281cd8d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:46.563004 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5e7a496a-f04a-4cd9-aeb1-e50e281cd8d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:46.564461 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5e7a496a-f04a-4cd9-aeb1-e50e281cd8d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:46.565598 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5e7a496a-f04a-4cd9-aeb1-e50e281cd8d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.157240 Sep 26 05:35:46.566686 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 405/831] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:46 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:47.591198 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-ad020318-96a1-49e6-9e79-9da4a791707e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:47.591815 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-ad020318-96a1-49e6-9e79-9da4a791707e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:47.598876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ad020318-96a1-49e6-9e79-9da4a791707e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:47.599361 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ad020318-96a1-49e6-9e79-9da4a791707e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:47.599800 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ad020318-96a1-49e6-9e79-9da4a791707e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:47.600799 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ad020318-96a1-49e6-9e79-9da4a791707e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:47.601251 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ad020318-96a1-49e6-9e79-9da4a791707e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:47.601673 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ad020318-96a1-49e6-9e79-9da4a791707e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:47.744599 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-ad020318-96a1-49e6-9e79-9da4a791707e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:47.752717 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-ad020318-96a1-49e6-9e79-9da4a791707e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:47.754389 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-ad020318-96a1-49e6-9e79-9da4a791707e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:47.755598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-ad020318-96a1-49e6-9e79-9da4a791707e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.168554 Sep 26 05:35:47.756160 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 427/832] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:47 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:48.781381 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b6148460-00d6-42d9-8f2c-a3322f65a7a2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:48.781996 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b6148460-00d6-42d9-8f2c-a3322f65a7a2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:48.788743 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6148460-00d6-42d9-8f2c-a3322f65a7a2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:48.789230 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6148460-00d6-42d9-8f2c-a3322f65a7a2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:48.789669 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6148460-00d6-42d9-8f2c-a3322f65a7a2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:48.790363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6148460-00d6-42d9-8f2c-a3322f65a7a2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:48.790822 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6148460-00d6-42d9-8f2c-a3322f65a7a2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:48.791252 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6148460-00d6-42d9-8f2c-a3322f65a7a2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:48.923446 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b6148460-00d6-42d9-8f2c-a3322f65a7a2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:48.931545 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b6148460-00d6-42d9-8f2c-a3322f65a7a2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:48.933024 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b6148460-00d6-42d9-8f2c-a3322f65a7a2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:48.934214 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b6148460-00d6-42d9-8f2c-a3322f65a7a2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.156737 Sep 26 05:35:48.934770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 406/833] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:48 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:49.959641 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-0f6bd43e-1b8b-4ff0-ae63-b59d4ba8daaa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:49.960356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-0f6bd43e-1b8b-4ff0-ae63-b59d4ba8daaa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:49.966906 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f6bd43e-1b8b-4ff0-ae63-b59d4ba8daaa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:49.967388 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f6bd43e-1b8b-4ff0-ae63-b59d4ba8daaa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:49.967822 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f6bd43e-1b8b-4ff0-ae63-b59d4ba8daaa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:49.968544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f6bd43e-1b8b-4ff0-ae63-b59d4ba8daaa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:49.968999 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f6bd43e-1b8b-4ff0-ae63-b59d4ba8daaa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:49.969424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f6bd43e-1b8b-4ff0-ae63-b59d4ba8daaa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:50.102554 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0f6bd43e-1b8b-4ff0-ae63-b59d4ba8daaa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:50.110623 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0f6bd43e-1b8b-4ff0-ae63-b59d4ba8daaa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:50.112082 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0f6bd43e-1b8b-4ff0-ae63-b59d4ba8daaa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:50.113937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-0f6bd43e-1b8b-4ff0-ae63-b59d4ba8daaa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.158242 Sep 26 05:35:50.114662 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 428/834] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:49 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:51.140328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5bd60d8f-4d90-43d2-9704-85145c957d4e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:51.140955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5bd60d8f-4d90-43d2-9704-85145c957d4e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:51.148163 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5bd60d8f-4d90-43d2-9704-85145c957d4e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:51.148884 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5bd60d8f-4d90-43d2-9704-85145c957d4e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:51.149299 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5bd60d8f-4d90-43d2-9704-85145c957d4e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:51.150126 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5bd60d8f-4d90-43d2-9704-85145c957d4e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:51.150727 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5bd60d8f-4d90-43d2-9704-85145c957d4e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:51.151238 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5bd60d8f-4d90-43d2-9704-85145c957d4e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:51.300163 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5bd60d8f-4d90-43d2-9704-85145c957d4e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:51.309675 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5bd60d8f-4d90-43d2-9704-85145c957d4e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:51.311466 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5bd60d8f-4d90-43d2-9704-85145c957d4e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:51.313263 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5bd60d8f-4d90-43d2-9704-85145c957d4e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1744 microversion: 2.20 time: 0.176679 Sep 26 05:35:51.314021 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 407/835] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:51 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:52.342016 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d428798c-975e-4e54-b42d-28c7f05da750 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:52.342585 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d428798c-975e-4e54-b42d-28c7f05da750 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:52.349565 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d428798c-975e-4e54-b42d-28c7f05da750 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:52.350045 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d428798c-975e-4e54-b42d-28c7f05da750 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:52.350727 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d428798c-975e-4e54-b42d-28c7f05da750 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:52.351411 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d428798c-975e-4e54-b42d-28c7f05da750 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:52.351859 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d428798c-975e-4e54-b42d-28c7f05da750 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:52.352294 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d428798c-975e-4e54-b42d-28c7f05da750 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:52.489192 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d428798c-975e-4e54-b42d-28c7f05da750 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:52.497418 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d428798c-975e-4e54-b42d-28c7f05da750 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:52.499021 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d428798c-975e-4e54-b42d-28c7f05da750 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:52.500190 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d428798c-975e-4e54-b42d-28c7f05da750 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1744 microversion: 2.20 time: 0.162211 Sep 26 05:35:52.500772 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 429/836] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:52 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:53.527022 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fedf671b-992d-4142-a13d-cfcf8cc06058 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:53.527796 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fedf671b-992d-4142-a13d-cfcf8cc06058 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:53.536067 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fedf671b-992d-4142-a13d-cfcf8cc06058 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:53.536578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fedf671b-992d-4142-a13d-cfcf8cc06058 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:53.537024 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fedf671b-992d-4142-a13d-cfcf8cc06058 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:53.537718 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fedf671b-992d-4142-a13d-cfcf8cc06058 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:53.538344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fedf671b-992d-4142-a13d-cfcf8cc06058 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:53.538872 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fedf671b-992d-4142-a13d-cfcf8cc06058 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:53.617429 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-92820936-4a89-4ccc-aa84-aa9a524de098 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:53.619764 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-92820936-4a89-4ccc-aa84-aa9a524de098 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:53.626728 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92820936-4a89-4ccc-aa84-aa9a524de098 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:53.627499 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92820936-4a89-4ccc-aa84-aa9a524de098 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:53.627938 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92820936-4a89-4ccc-aa84-aa9a524de098 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:53.628897 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92820936-4a89-4ccc-aa84-aa9a524de098 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:53.629551 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92820936-4a89-4ccc-aa84-aa9a524de098 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:53.630163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92820936-4a89-4ccc-aa84-aa9a524de098 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:53.664668 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-92820936-4a89-4ccc-aa84-aa9a524de098 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051097 Sep 26 05:35:53.665261 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 430/837] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:35:53 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 26 05:35:53.738723 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-0f0abefe-e369-4439-8563-aeb06b6ed9cd tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:53.739225 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-0f0abefe-e369-4439-8563-aeb06b6ed9cd tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:53.745892 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f0abefe-e369-4439-8563-aeb06b6ed9cd tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:53.746886 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f0abefe-e369-4439-8563-aeb06b6ed9cd tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:53.746886 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f0abefe-e369-4439-8563-aeb06b6ed9cd tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:53.747507 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f0abefe-e369-4439-8563-aeb06b6ed9cd tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:53.747943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f0abefe-e369-4439-8563-aeb06b6ed9cd tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:53.748401 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f0abefe-e369-4439-8563-aeb06b6ed9cd tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:53.774810 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-0f0abefe-e369-4439-8563-aeb06b6ed9cd tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Going to try to terminate instance {{(pid=120806) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:35:53.850747 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fedf671b-992d-4142-a13d-cfcf8cc06058 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:53.859867 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fedf671b-992d-4142-a13d-cfcf8cc06058 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:53.861677 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fedf671b-992d-4142-a13d-cfcf8cc06058 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:53.863614 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fedf671b-992d-4142-a13d-cfcf8cc06058 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1739 microversion: 2.20 time: 0.341289 Sep 26 05:35:53.864817 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 408/838] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:53 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:53.882347 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-0f0abefe-e369-4439-8563-aeb06b6ed9cd tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "DELETE /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 204 len: 0 microversion: 2.1 time: 0.147762 Sep 26 05:35:53.883044 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 431/839] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:35:53 2022] DELETE /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 05:35:53.891513 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3b16a152-f01b-4fad-a043-128eeaaeb5d8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:53.892162 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3b16a152-f01b-4fad-a043-128eeaaeb5d8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:53.898685 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b16a152-f01b-4fad-a043-128eeaaeb5d8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:53.899170 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b16a152-f01b-4fad-a043-128eeaaeb5d8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:53.899611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b16a152-f01b-4fad-a043-128eeaaeb5d8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:53.900418 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b16a152-f01b-4fad-a043-128eeaaeb5d8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:53.900881 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b16a152-f01b-4fad-a043-128eeaaeb5d8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:53.901378 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b16a152-f01b-4fad-a043-128eeaaeb5d8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:54.057711 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3b16a152-f01b-4fad-a043-128eeaaeb5d8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:54.066267 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3b16a152-f01b-4fad-a043-128eeaaeb5d8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1674 microversion: 2.1 time: 0.178071 Sep 26 05:35:54.067127 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 409/840] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:53 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:35:54.293133 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-ed8ed5df-c256-455d-b2ec-3e00a4bdd476 req-5817d342-dc1e-49ad-8fd6-af4e9bd1b361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e", "name": "network-vif-plugged", "status": "completed", "tag": "d2d361e4-87bf-4197-9996-68e762a01ce3"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:35:54.326151 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-ed8ed5df-c256-455d-b2ec-3e00a4bdd476 req-5817d342-dc1e-49ad-8fd6-af4e9bd1b361 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:54.326662 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-ed8ed5df-c256-455d-b2ec-3e00a4bdd476 req-5817d342-dc1e-49ad-8fd6-af4e9bd1b361 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:54.327119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-ed8ed5df-c256-455d-b2ec-3e00a4bdd476 req-5817d342-dc1e-49ad-8fd6-af4e9bd1b361 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:54.368100 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-ed8ed5df-c256-455d-b2ec-3e00a4bdd476 req-5817d342-dc1e-49ad-8fd6-af4e9bd1b361 service nova] Creating event network-vif-plugged:d2d361e4-87bf-4197-9996-68e762a01ce3 for instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e on hv-cinder-85918 Sep 26 05:35:54.392194 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-ed8ed5df-c256-455d-b2ec-3e00a4bdd476 req-5817d342-dc1e-49ad-8fd6-af4e9bd1b361 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106133 Sep 26 05:35:54.392865 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 432/841] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:35:54.890878 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-97f92bf4-0494-4e6d-8110-4e85d7b2aba4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:54.891507 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-97f92bf4-0494-4e6d-8110-4e85d7b2aba4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:54.898740 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-97f92bf4-0494-4e6d-8110-4e85d7b2aba4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:54.899545 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-97f92bf4-0494-4e6d-8110-4e85d7b2aba4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:54.900222 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-97f92bf4-0494-4e6d-8110-4e85d7b2aba4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:54.901850 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-97f92bf4-0494-4e6d-8110-4e85d7b2aba4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:54.902531 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-97f92bf4-0494-4e6d-8110-4e85d7b2aba4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:54.903164 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-97f92bf4-0494-4e6d-8110-4e85d7b2aba4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:55.091012 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-0e9991f7-28b7-4a23-ad24-b4823596c5cc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:55.092487 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-0e9991f7-28b7-4a23-ad24-b4823596c5cc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:55.100717 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0e9991f7-28b7-4a23-ad24-b4823596c5cc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:55.101533 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0e9991f7-28b7-4a23-ad24-b4823596c5cc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:55.102560 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0e9991f7-28b7-4a23-ad24-b4823596c5cc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:55.104806 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0e9991f7-28b7-4a23-ad24-b4823596c5cc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:55.106899 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0e9991f7-28b7-4a23-ad24-b4823596c5cc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:55.107855 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0e9991f7-28b7-4a23-ad24-b4823596c5cc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:55.109543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-97f92bf4-0494-4e6d-8110-4e85d7b2aba4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:55.123064 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-97f92bf4-0494-4e6d-8110-4e85d7b2aba4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:55.124806 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-97f92bf4-0494-4e6d-8110-4e85d7b2aba4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:55.126200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-97f92bf4-0494-4e6d-8110-4e85d7b2aba4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1739 microversion: 2.20 time: 0.239403 Sep 26 05:35:55.126933 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 410/842] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:54 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:55.294521 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0e9991f7-28b7-4a23-ad24-b4823596c5cc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:55.307119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-0e9991f7-28b7-4a23-ad24-b4823596c5cc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1674 microversion: 2.1 time: 0.220967 Sep 26 05:35:55.308445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 433/843] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:55 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1674 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:35:56.152153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4bd8beb6-fbf2-484d-8a45-dc4a8bc693dd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:56.153493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4bd8beb6-fbf2-484d-8a45-dc4a8bc693dd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:56.161774 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4bd8beb6-fbf2-484d-8a45-dc4a8bc693dd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:56.162480 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4bd8beb6-fbf2-484d-8a45-dc4a8bc693dd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:56.163438 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4bd8beb6-fbf2-484d-8a45-dc4a8bc693dd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:56.164485 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4bd8beb6-fbf2-484d-8a45-dc4a8bc693dd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:56.165146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4bd8beb6-fbf2-484d-8a45-dc4a8bc693dd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:56.165898 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4bd8beb6-fbf2-484d-8a45-dc4a8bc693dd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:56.318982 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4bd8beb6-fbf2-484d-8a45-dc4a8bc693dd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:56.334791 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-aff1956e-6e26-418a-ae08-1dc1c5887364 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:56.335490 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-aff1956e-6e26-418a-ae08-1dc1c5887364 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:56.339846 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4bd8beb6-fbf2-484d-8a45-dc4a8bc693dd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:56.346335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4bd8beb6-fbf2-484d-8a45-dc4a8bc693dd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:56.348735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4bd8beb6-fbf2-484d-8a45-dc4a8bc693dd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1739 microversion: 2.20 time: 0.200402 Sep 26 05:35:56.349884 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-aff1956e-6e26-418a-ae08-1dc1c5887364 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:56.350805 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 411/844] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:56 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:56.351387 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-aff1956e-6e26-418a-ae08-1dc1c5887364 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:56.352013 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-aff1956e-6e26-418a-ae08-1dc1c5887364 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:56.352941 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-aff1956e-6e26-418a-ae08-1dc1c5887364 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:56.353616 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-aff1956e-6e26-418a-ae08-1dc1c5887364 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:56.354195 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-aff1956e-6e26-418a-ae08-1dc1c5887364 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:56.518910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-aff1956e-6e26-418a-ae08-1dc1c5887364 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:56.528200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-aff1956e-6e26-418a-ae08-1dc1c5887364 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1674 microversion: 2.1 time: 0.197208 Sep 26 05:35:56.528807 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 434/845] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:56 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1674 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:35:57.379727 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7bfb4d69-84d2-45cf-b925-ff3c1b7cbdd9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:57.381501 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7bfb4d69-84d2-45cf-b925-ff3c1b7cbdd9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:57.396556 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bfb4d69-84d2-45cf-b925-ff3c1b7cbdd9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:57.402878 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bfb4d69-84d2-45cf-b925-ff3c1b7cbdd9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:57.404039 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bfb4d69-84d2-45cf-b925-ff3c1b7cbdd9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:57.405001 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bfb4d69-84d2-45cf-b925-ff3c1b7cbdd9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:57.405629 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bfb4d69-84d2-45cf-b925-ff3c1b7cbdd9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:57.406372 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bfb4d69-84d2-45cf-b925-ff3c1b7cbdd9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:57.553725 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9fa0f309-7a78-4b5b-98d0-719589026def tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:57.555438 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-9fa0f309-7a78-4b5b-98d0-719589026def tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:57.566381 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9fa0f309-7a78-4b5b-98d0-719589026def tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:57.567005 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9fa0f309-7a78-4b5b-98d0-719589026def tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:57.567628 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9fa0f309-7a78-4b5b-98d0-719589026def tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:57.568977 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9fa0f309-7a78-4b5b-98d0-719589026def tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:57.569434 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9fa0f309-7a78-4b5b-98d0-719589026def tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:57.569858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9fa0f309-7a78-4b5b-98d0-719589026def tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:57.719475 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7bfb4d69-84d2-45cf-b925-ff3c1b7cbdd9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:57.729633 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7bfb4d69-84d2-45cf-b925-ff3c1b7cbdd9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:57.730955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7bfb4d69-84d2-45cf-b925-ff3c1b7cbdd9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:57.737197 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7bfb4d69-84d2-45cf-b925-ff3c1b7cbdd9 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1739 microversion: 2.20 time: 0.362820 Sep 26 05:35:57.738555 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 412/846] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:57 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1739 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:57.822470 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-9fa0f309-7a78-4b5b-98d0-719589026def tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:57.830609 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-9fa0f309-7a78-4b5b-98d0-719589026def tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1674 microversion: 2.1 time: 0.281690 Sep 26 05:35:57.831519 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 435/847] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:57 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1674 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:35:58.374255 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-a4ce581f-57e3-4a1c-a2cc-7e2e05c024b5 req-5d4b23a2-0e98-4bf2-8483-f1225bf71396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de4a6090-4a17-4d48-806a-1fbfb8556e47", "name": "network-vif-deleted", "tag": "6c8f3d3c-69f4-4522-90e1-444ce9de2135"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:35:58.410603 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-a4ce581f-57e3-4a1c-a2cc-7e2e05c024b5 req-5d4b23a2-0e98-4bf2-8483-f1225bf71396 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:58.413381 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-a4ce581f-57e3-4a1c-a2cc-7e2e05c024b5 req-5d4b23a2-0e98-4bf2-8483-f1225bf71396 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:58.414221 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-a4ce581f-57e3-4a1c-a2cc-7e2e05c024b5 req-5d4b23a2-0e98-4bf2-8483-f1225bf71396 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:58.450791 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-a4ce581f-57e3-4a1c-a2cc-7e2e05c024b5 req-5d4b23a2-0e98-4bf2-8483-f1225bf71396 service nova] Creating event network-vif-deleted:6c8f3d3c-69f4-4522-90e1-444ce9de2135 for instance de4a6090-4a17-4d48-806a-1fbfb8556e47 on hv-cinder-85918 Sep 26 05:35:58.473313 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-a4ce581f-57e3-4a1c-a2cc-7e2e05c024b5 req-5d4b23a2-0e98-4bf2-8483-f1225bf71396 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098221 Sep 26 05:35:58.474811 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 413/848] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:35:58.767052 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-82564762-ab60-436e-953c-30dedaebdbc7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:58.768091 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-82564762-ab60-436e-953c-30dedaebdbc7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:58.783464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-82564762-ab60-436e-953c-30dedaebdbc7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:58.784092 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-82564762-ab60-436e-953c-30dedaebdbc7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:58.785894 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-82564762-ab60-436e-953c-30dedaebdbc7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:58.789249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-82564762-ab60-436e-953c-30dedaebdbc7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:58.790002 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-82564762-ab60-436e-953c-30dedaebdbc7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:58.790609 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-82564762-ab60-436e-953c-30dedaebdbc7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:59.026720 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-82564762-ab60-436e-953c-30dedaebdbc7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:59.036447 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-82564762-ab60-436e-953c-30dedaebdbc7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:59.037890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-82564762-ab60-436e-953c-30dedaebdbc7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:59.048010 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-82564762-ab60-436e-953c-30dedaebdbc7 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1739 microversion: 2.20 time: 0.277472 Sep 26 05:35:59.049095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 436/849] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:35:58 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:35:59.140472 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-95d689a7-9e5a-4a74-a2e5-39eff239a249 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:59.141373 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-95d689a7-9e5a-4a74-a2e5-39eff239a249 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:35:59.149574 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95d689a7-9e5a-4a74-a2e5-39eff239a249 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:59.150069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95d689a7-9e5a-4a74-a2e5-39eff239a249 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:59.150505 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95d689a7-9e5a-4a74-a2e5-39eff239a249 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:59.151254 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95d689a7-9e5a-4a74-a2e5-39eff239a249 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:59.151874 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95d689a7-9e5a-4a74-a2e5-39eff239a249 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:59.152479 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95d689a7-9e5a-4a74-a2e5-39eff239a249 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:59.228427 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95d689a7-9e5a-4a74-a2e5-39eff239a249 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:59.238174 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95d689a7-9e5a-4a74-a2e5-39eff239a249 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:59.238820 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95d689a7-9e5a-4a74-a2e5-39eff239a249 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:59.240015 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-95d689a7-9e5a-4a74-a2e5-39eff239a249 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lazy-loading 'fault' on Instance uuid de4a6090-4a17-4d48-806a-1fbfb8556e47 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:35:59.347546 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-95d689a7-9e5a-4a74-a2e5-39eff239a249 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:35:59.364493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-95d689a7-9e5a-4a74-a2e5-39eff239a249 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 200 len: 1328 microversion: 2.1 time: 0.506926 Sep 26 05:35:59.365067 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 414/850] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:35:58 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 1328 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:00.077148 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-0db31c97-095e-4bb7-86df-b1c4b1e86c1e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:00.077944 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-0db31c97-095e-4bb7-86df-b1c4b1e86c1e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:00.088827 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0db31c97-095e-4bb7-86df-b1c4b1e86c1e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:00.090348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0db31c97-095e-4bb7-86df-b1c4b1e86c1e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:00.091143 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0db31c97-095e-4bb7-86df-b1c4b1e86c1e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:00.091880 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0db31c97-095e-4bb7-86df-b1c4b1e86c1e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:00.092368 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0db31c97-095e-4bb7-86df-b1c4b1e86c1e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:00.092890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0db31c97-095e-4bb7-86df-b1c4b1e86c1e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:00.113037 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:00.278505 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0db31c97-095e-4bb7-86df-b1c4b1e86c1e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:00.294254 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0db31c97-095e-4bb7-86df-b1c4b1e86c1e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:00.299025 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0db31c97-095e-4bb7-86df-b1c4b1e86c1e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:00.301318 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-0db31c97-095e-4bb7-86df-b1c4b1e86c1e tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1739 microversion: 2.20 time: 0.228432 Sep 26 05:36:00.308678 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 437/851] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:00 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:00.391077 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-989d2318-5366-4d08-b262-24441a9667d9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:00.392342 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-989d2318-5366-4d08-b262-24441a9667d9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:00.400391 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-989d2318-5366-4d08-b262-24441a9667d9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:00.400910 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-989d2318-5366-4d08-b262-24441a9667d9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:00.401210 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-989d2318-5366-4d08-b262-24441a9667d9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:00.402155 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-989d2318-5366-4d08-b262-24441a9667d9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:00.402557 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-989d2318-5366-4d08-b262-24441a9667d9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:00.403092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-989d2318-5366-4d08-b262-24441a9667d9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:00.417366 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-989d2318-5366-4d08-b262-24441a9667d9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] HTTP exception thrown: Instance de4a6090-4a17-4d48-806a-1fbfb8556e47 could not be found. Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-989d2318-5366-4d08-b262-24441a9667d9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Request method failure captured: Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 HTTP/1.1 Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTkReKLe6I7Hw9o7xQNJ90qh6MG2KreFJbp_Iam3kZtx0-WRsoTrmAli0yXytCDoRWiSs8pBAv-XpwPaEBOpwEpunytNr5KFIP8u_hso_HCqNwk1sSPVnpJkCRVSRQ7fKYGccIGT2A_vi_JM_Gt7MDB6v9F9dZprqhCM9Wa72r_wZgA Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: 49fe69e57e744eea93988aecfa9decc2 Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeTestJSON-868830527 Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:36:00.419025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:36:00.420792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49fe69e57e744eea93988aecfa9decc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49fe69e57e744eea93988aecfa9decc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49fe69e57e744eea93988aecfa9decc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49fe69e57e744eea93988aecfa9decc2"}]}] Sep 26 05:36:00.420792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeTestJSON-868830527 Sep 26 05:36:00.420792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 49fe69e57e744eea93988aecfa9decc2 Sep 26 05:36:00.420792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeTestJSON-868830527 Sep 26 05:36:00.420792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeTestJSON-868830527-project Sep 26 05:36:00.420792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:36:00.420792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:36:00.420792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 30ccb163613a40ac8042f229199717f6 Sep 26 05:36:00.420792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeTestJSON-868830527-project Sep 26 05:36:00.420792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:36:00.420792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance de4a6090-4a17-4d48-806a-1fbfb8556e47 could not be found. Sep 26 05:36:00.420792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': 'de4a6090-4a17-4d48-806a-1fbfb8556e47'} Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de4a6090-4a17-4d48-806a-1fbfb8556e47 could not be found. Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:36:00.421611 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:36:00.422961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:36:00.422961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:36:00.422961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:36:00.422961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:36:00.422961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:36:00.422961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:36:00.422961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:36:00.422961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de4a6090-4a17-4d48-806a-1fbfb8556e47 could not be found. Sep 26 05:36:00.422961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:00.422961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:00.422961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:00.422961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:00.422961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:00.422961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:00.422961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:36:00.422961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:36:00.422961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de4a6090-4a17-4d48-806a-1fbfb8556e47 could not be found. Sep 26 05:36:00.422961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:00.424150 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-989d2318-5366-4d08-b262-24441a9667d9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Returning 404 to user: Instance de4a6090-4a17-4d48-806a-1fbfb8556e47 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:36:00.424150 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-989d2318-5366-4d08-b262-24441a9667d9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 404 len: 111 microversion: 2.1 time: 0.034264 Sep 26 05:36:00.424150 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 415/852] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:00 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:36:00.430911 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-62931c3a-03e3-41ea-adc0-4a46aebbe8fc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '.version_select at 0x7fd7b739a550>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:00.457398 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-62931c3a-03e3-41ea-adc0-4a46aebbe8fc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769127885" status: 202 len: 0 microversion: 2.1 time: 0.029625 Sep 26 05:36:00.458088 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 438/853] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Sep 26 05:36:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769127885 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:36:01.283286 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7d059c2e-c9ba-42fb-ad62-1e6d42511d6b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Action: 'create', calling method: .version_select at 0x7fd7b71f9a60>, body: {"keypair": {"name": "tempest-keypair-145463540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcC1osjuDsaOrg2jHQBecLTX8wTQGdDl+AMdSSNy7J9HNwMaMeZyfAENLULQ7r3h7J93zc9+mNDvadyN+hR3crNPuwjHeM0h9xqVLWDvvmyK+fXoHswk7q9cqNaVedAeQ=="}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:01.302310 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-7d059c2e-c9ba-42fb-ad62-1e6d42511d6b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Getting quotas for project 49fe69e57e744eea93988aecfa9decc2. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:36:01.306458 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-7d059c2e-c9ba-42fb-ad62-1e6d42511d6b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Getting quotas for user 30ccb163613a40ac8042f229199717f6 and project 49fe69e57e744eea93988aecfa9decc2. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:36:01.327757 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-be81fb04-885a-4168-bc39-4a0f34a0b157 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:01.328489 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-be81fb04-885a-4168-bc39-4a0f34a0b157 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:01.331997 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7d059c2e-c9ba-42fb-ad62-1e6d42511d6b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052888 Sep 26 05:36:01.332842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 416/854] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 05:36:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:36:01.336553 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-be81fb04-885a-4168-bc39-4a0f34a0b157 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:01.337420 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-be81fb04-885a-4168-bc39-4a0f34a0b157 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:01.337864 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-be81fb04-885a-4168-bc39-4a0f34a0b157 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:01.338780 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-be81fb04-885a-4168-bc39-4a0f34a0b157 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:01.339948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-be81fb04-885a-4168-bc39-4a0f34a0b157 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:01.340571 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-be81fb04-885a-4168-bc39-4a0f34a0b157 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:01.879038 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-be81fb04-885a-4168-bc39-4a0f34a0b157 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:01.907899 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-be81fb04-885a-4168-bc39-4a0f34a0b157 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:01.917657 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-be81fb04-885a-4168-bc39-4a0f34a0b157 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:01.922061 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-be81fb04-885a-4168-bc39-4a0f34a0b157 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1739 microversion: 2.20 time: 0.597612 Sep 26 05:36:01.928595 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 439/855] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:01 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1739 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:02.953740 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bab04940-acf2-4663-941f-b75e06ba1d99 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:02.954362 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bab04940-acf2-4663-941f-b75e06ba1d99 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:02.969756 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bab04940-acf2-4663-941f-b75e06ba1d99 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:02.970423 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bab04940-acf2-4663-941f-b75e06ba1d99 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:02.970910 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bab04940-acf2-4663-941f-b75e06ba1d99 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:02.972414 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bab04940-acf2-4663-941f-b75e06ba1d99 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:02.973075 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bab04940-acf2-4663-941f-b75e06ba1d99 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:02.973694 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bab04940-acf2-4663-941f-b75e06ba1d99 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:03.158232 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bab04940-acf2-4663-941f-b75e06ba1d99 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:03.168177 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bab04940-acf2-4663-941f-b75e06ba1d99 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:03.169655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bab04940-acf2-4663-941f-b75e06ba1d99 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:03.172707 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bab04940-acf2-4663-941f-b75e06ba1d99 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1739 microversion: 2.20 time: 0.222222 Sep 26 05:36:03.185539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 417/856] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:02 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:03.220867 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7ef5c1bb-5b87-410b-9f7e-a4a2110b3573 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1818649142", "imageRef": "d37a4f3d-6311-48af-9e33-4c62c14cdd1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6a60f69-a1be-43ae-8a50-02a99ceaebaf"}], "security_groups": [{"name": "tempest-securitygroup--255340517"}], "key_name": "tempest-keypair-145463540", "user_data": "}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:03.398204 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.network.neutron [None req-7ef5c1bb-5b87-410b-9f7e-a4a2110b3573 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] validate_networks() for [('d6a60f69-a1be-43ae-8a50-02a99ceaebaf', None, None, None, None, None)] {{(pid=120806) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:36:04.109208 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-7ef5c1bb-5b87-410b-9f7e-a4a2110b3573 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Flavor limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:36:04.109640 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-7ef5c1bb-5b87-410b-9f7e-a4a2110b3573 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Image limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:36:04.110108 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-7ef5c1bb-5b87-410b-9f7e-a4a2110b3573 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Flavor pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:36:04.110521 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-7ef5c1bb-5b87-410b-9f7e-a4a2110b3573 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Image pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:36:04.110938 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-7ef5c1bb-5b87-410b-9f7e-a4a2110b3573 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:36:04.122797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7ef5c1bb-5b87-410b-9f7e-a4a2110b3573 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:04.123171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7ef5c1bb-5b87-410b-9f7e-a4a2110b3573 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:04.123613 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7ef5c1bb-5b87-410b-9f7e-a4a2110b3573 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:04.124357 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7ef5c1bb-5b87-410b-9f7e-a4a2110b3573 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:04.125011 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7ef5c1bb-5b87-410b-9f7e-a4a2110b3573 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:04.125614 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7ef5c1bb-5b87-410b-9f7e-a4a2110b3573 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:04.153112 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-7ef5c1bb-5b87-410b-9f7e-a4a2110b3573 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Getting quotas for project 49fe69e57e744eea93988aecfa9decc2. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:36:04.170532 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-7ef5c1bb-5b87-410b-9f7e-a4a2110b3573 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Getting quotas for user 30ccb163613a40ac8042f229199717f6 and project 49fe69e57e744eea93988aecfa9decc2. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:36:04.186794 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7ef5c1bb-5b87-410b-9f7e-a4a2110b3573 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Going to run 1 instances... {{(pid=120806) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:36:04.189723 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7ef5c1bb-5b87-410b-9f7e-a4a2110b3573 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d37a4f3d-6311-48af-9e33-4c62c14cdd1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120806) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:36:04.200543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-db00439e-35ba-4107-b235-f345ce3ede16 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:04.201142 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-db00439e-35ba-4107-b235-f345ce3ede16 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:04.208901 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-db00439e-35ba-4107-b235-f345ce3ede16 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:04.216731 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-db00439e-35ba-4107-b235-f345ce3ede16 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:04.219371 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-db00439e-35ba-4107-b235-f345ce3ede16 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:04.222559 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-db00439e-35ba-4107-b235-f345ce3ede16 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:04.223306 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-db00439e-35ba-4107-b235-f345ce3ede16 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:04.224319 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-db00439e-35ba-4107-b235-f345ce3ede16 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:04.280976 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7ef5c1bb-5b87-410b-9f7e-a4a2110b3573 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.064798 Sep 26 05:36:04.281749 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 440/857] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:36:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:36:04.298691 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-05bec9dc-f507-4b10-8491-e2e795ff5bad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:04.299930 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-05bec9dc-f507-4b10-8491-e2e795ff5bad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:04.423437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-05bec9dc-f507-4b10-8491-e2e795ff5bad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:04.445165 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-05bec9dc-f507-4b10-8491-e2e795ff5bad tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1237 microversion: 2.1 time: 0.148620 Sep 26 05:36:04.447189 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 441/858] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:04 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1237 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:04.520421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-db00439e-35ba-4107-b235-f345ce3ede16 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:04.529592 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-db00439e-35ba-4107-b235-f345ce3ede16 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:04.531740 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-db00439e-35ba-4107-b235-f345ce3ede16 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:04.533279 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-db00439e-35ba-4107-b235-f345ce3ede16 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1739 microversion: 2.20 time: 0.336371 Sep 26 05:36:04.535458 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 418/859] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:04 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1739 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:36:05.469323 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c4a269f5-b82e-45c8-8403-dd26d50c82f8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:05.469952 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c4a269f5-b82e-45c8-8403-dd26d50c82f8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:05.476658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c4a269f5-b82e-45c8-8403-dd26d50c82f8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:05.477360 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c4a269f5-b82e-45c8-8403-dd26d50c82f8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:05.477773 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c4a269f5-b82e-45c8-8403-dd26d50c82f8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:05.478462 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c4a269f5-b82e-45c8-8403-dd26d50c82f8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:05.478910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c4a269f5-b82e-45c8-8403-dd26d50c82f8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:05.479337 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c4a269f5-b82e-45c8-8403-dd26d50c82f8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:05.546111 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-c4a269f5-b82e-45c8-8403-dd26d50c82f8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:05.554976 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c4a269f5-b82e-45c8-8403-dd26d50c82f8 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1289 microversion: 2.1 time: 0.089721 Sep 26 05:36:05.563346 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ef65ee0c-8e90-4aad-9e7d-b893d24cdefd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:05.564717 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ef65ee0c-8e90-4aad-9e7d-b893d24cdefd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:05.572643 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 442/860] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:05 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1289 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:05.573188 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ef65ee0c-8e90-4aad-9e7d-b893d24cdefd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:05.573879 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ef65ee0c-8e90-4aad-9e7d-b893d24cdefd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:05.574658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ef65ee0c-8e90-4aad-9e7d-b893d24cdefd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:05.575514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ef65ee0c-8e90-4aad-9e7d-b893d24cdefd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:05.576127 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ef65ee0c-8e90-4aad-9e7d-b893d24cdefd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:05.576743 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ef65ee0c-8e90-4aad-9e7d-b893d24cdefd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:05.718055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ef65ee0c-8e90-4aad-9e7d-b893d24cdefd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:05.731711 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ef65ee0c-8e90-4aad-9e7d-b893d24cdefd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:05.733326 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ef65ee0c-8e90-4aad-9e7d-b893d24cdefd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:05.735271 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ef65ee0c-8e90-4aad-9e7d-b893d24cdefd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1739 microversion: 2.20 time: 0.176126 Sep 26 05:36:05.736625 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 419/861] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:05 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:36:06.581332 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-154cc3de-52b7-40a0-bfe9-47a1a1ef5761 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:06.582779 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-154cc3de-52b7-40a0-bfe9-47a1a1ef5761 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:06.589671 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-154cc3de-52b7-40a0-bfe9-47a1a1ef5761 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:06.590408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-154cc3de-52b7-40a0-bfe9-47a1a1ef5761 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:06.590856 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-154cc3de-52b7-40a0-bfe9-47a1a1ef5761 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:06.591579 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-154cc3de-52b7-40a0-bfe9-47a1a1ef5761 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:06.592024 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-154cc3de-52b7-40a0-bfe9-47a1a1ef5761 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:06.592680 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-154cc3de-52b7-40a0-bfe9-47a1a1ef5761 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:06.682835 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-154cc3de-52b7-40a0-bfe9-47a1a1ef5761 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:06.691975 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-154cc3de-52b7-40a0-bfe9-47a1a1ef5761 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1295 microversion: 2.1 time: 0.116861 Sep 26 05:36:06.693229 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 443/862] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:06 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1295 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:06.763706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-de241d0f-b20a-4390-bc6b-3fcd1ceb1b2f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:06.764372 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-de241d0f-b20a-4390-bc6b-3fcd1ceb1b2f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:06.773264 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-de241d0f-b20a-4390-bc6b-3fcd1ceb1b2f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:06.774070 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-de241d0f-b20a-4390-bc6b-3fcd1ceb1b2f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:06.774619 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-de241d0f-b20a-4390-bc6b-3fcd1ceb1b2f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:06.775470 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-de241d0f-b20a-4390-bc6b-3fcd1ceb1b2f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:06.776029 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-de241d0f-b20a-4390-bc6b-3fcd1ceb1b2f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:06.776913 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-de241d0f-b20a-4390-bc6b-3fcd1ceb1b2f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:06.980991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-de241d0f-b20a-4390-bc6b-3fcd1ceb1b2f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:06.990414 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-de241d0f-b20a-4390-bc6b-3fcd1ceb1b2f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:06.991856 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-de241d0f-b20a-4390-bc6b-3fcd1ceb1b2f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:06.993157 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-de241d0f-b20a-4390-bc6b-3fcd1ceb1b2f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1721 microversion: 2.20 time: 0.233512 Sep 26 05:36:06.993724 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 420/863] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:06 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:07.625197 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-565fa168-31cf-4c37-b59e-9f2766fa8c1c req-53ea6a78-91ab-4d29-a2b4-f752812a36cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69ae32da-8cf7-4b65-9387-3d013453dbe5", "tag": "5c2eb711-a069-49dc-aca7-800571583c6a"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:07.635981 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-565fa168-31cf-4c37-b59e-9f2766fa8c1c req-53ea6a78-91ab-4d29-a2b4-f752812a36cc service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:07.636489 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-565fa168-31cf-4c37-b59e-9f2766fa8c1c req-53ea6a78-91ab-4d29-a2b4-f752812a36cc service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:07.636923 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-565fa168-31cf-4c37-b59e-9f2766fa8c1c req-53ea6a78-91ab-4d29-a2b4-f752812a36cc service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:07.655384 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-565fa168-31cf-4c37-b59e-9f2766fa8c1c req-53ea6a78-91ab-4d29-a2b4-f752812a36cc service nova] Creating event network-changed:5c2eb711-a069-49dc-aca7-800571583c6a for instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 on hv-cinder-85918 Sep 26 05:36:07.661837 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-565fa168-31cf-4c37-b59e-9f2766fa8c1c req-53ea6a78-91ab-4d29-a2b4-f752812a36cc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042004 Sep 26 05:36:07.663014 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 444/864] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:36:07.719380 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0a0fd7e6-fe92-4f49-b231-67fb697dc1ec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:07.720117 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0a0fd7e6-fe92-4f49-b231-67fb697dc1ec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:07.728264 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a0fd7e6-fe92-4f49-b231-67fb697dc1ec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:07.728758 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a0fd7e6-fe92-4f49-b231-67fb697dc1ec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:07.729203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a0fd7e6-fe92-4f49-b231-67fb697dc1ec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:07.730295 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a0fd7e6-fe92-4f49-b231-67fb697dc1ec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:07.730436 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a0fd7e6-fe92-4f49-b231-67fb697dc1ec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:07.730784 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a0fd7e6-fe92-4f49-b231-67fb697dc1ec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:07.873876 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0a0fd7e6-fe92-4f49-b231-67fb697dc1ec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:07.882125 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0a0fd7e6-fe92-4f49-b231-67fb697dc1ec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1362 microversion: 2.1 time: 0.170585 Sep 26 05:36:07.882687 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 421/865] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:07 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:08.022765 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-2902f64c-90ce-4918-8468-e432bfc81579 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:08.023462 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-2902f64c-90ce-4918-8468-e432bfc81579 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:08.025496 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:08.031145 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2902f64c-90ce-4918-8468-e432bfc81579 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:08.031618 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2902f64c-90ce-4918-8468-e432bfc81579 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:08.032047 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2902f64c-90ce-4918-8468-e432bfc81579 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:08.032749 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2902f64c-90ce-4918-8468-e432bfc81579 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:08.033205 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2902f64c-90ce-4918-8468-e432bfc81579 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:08.033656 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2902f64c-90ce-4918-8468-e432bfc81579 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:08.164457 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2902f64c-90ce-4918-8468-e432bfc81579 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:08.172518 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2902f64c-90ce-4918-8468-e432bfc81579 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:08.173954 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2902f64c-90ce-4918-8468-e432bfc81579 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:08.175267 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2902f64c-90ce-4918-8468-e432bfc81579 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1721 microversion: 2.20 time: 0.157462 Sep 26 05:36:08.175851 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 445/866] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:08 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:08.906148 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5a716a3b-65e1-461f-b902-e544f3f5bb62 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:08.906873 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5a716a3b-65e1-461f-b902-e544f3f5bb62 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:08.914951 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a716a3b-65e1-461f-b902-e544f3f5bb62 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:08.915200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a716a3b-65e1-461f-b902-e544f3f5bb62 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:08.915773 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a716a3b-65e1-461f-b902-e544f3f5bb62 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:08.916628 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a716a3b-65e1-461f-b902-e544f3f5bb62 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:08.917789 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a716a3b-65e1-461f-b902-e544f3f5bb62 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:08.917789 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a716a3b-65e1-461f-b902-e544f3f5bb62 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:09.111137 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5a716a3b-65e1-461f-b902-e544f3f5bb62 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:09.121786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5a716a3b-65e1-461f-b902-e544f3f5bb62 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1362 microversion: 2.1 time: 0.219940 Sep 26 05:36:09.122614 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 422/867] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:08 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:36:09.202878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7cbb3743-49d7-401b-a094-66357d3acb09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:09.203894 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7cbb3743-49d7-401b-a094-66357d3acb09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:09.212809 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7cbb3743-49d7-401b-a094-66357d3acb09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:09.213621 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7cbb3743-49d7-401b-a094-66357d3acb09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:09.214161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7cbb3743-49d7-401b-a094-66357d3acb09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:09.214996 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7cbb3743-49d7-401b-a094-66357d3acb09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:09.216474 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7cbb3743-49d7-401b-a094-66357d3acb09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:09.217012 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7cbb3743-49d7-401b-a094-66357d3acb09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:09.379562 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7cbb3743-49d7-401b-a094-66357d3acb09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:09.387646 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7cbb3743-49d7-401b-a094-66357d3acb09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:09.389125 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7cbb3743-49d7-401b-a094-66357d3acb09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:09.390276 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7cbb3743-49d7-401b-a094-66357d3acb09 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1724 microversion: 2.20 time: 0.193208 Sep 26 05:36:09.390830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 446/868] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:09 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:36:09.415807 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-30a8a105-d262-4b61-9e2f-43a1e924b1d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6698a38-df59-4711-bde0-a60f38cacae4"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:09.418258 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-30a8a105-d262-4b61-9e2f-43a1e924b1d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:09.420279 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:09.426109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30a8a105-d262-4b61-9e2f-43a1e924b1d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:09.426595 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30a8a105-d262-4b61-9e2f-43a1e924b1d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:09.427037 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30a8a105-d262-4b61-9e2f-43a1e924b1d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:09.427733 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30a8a105-d262-4b61-9e2f-43a1e924b1d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:09.428189 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30a8a105-d262-4b61-9e2f-43a1e924b1d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:09.428647 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30a8a105-d262-4b61-9e2f-43a1e924b1d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:09.443400 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:09.713846 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-30a8a105-d262-4b61-9e2f-43a1e924b1d3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "POST /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.302082 Sep 26 05:36:09.714477 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 423/869] 10.222.0.49 () {62 vars in 1364 bytes} [Mon Sep 26 05:36:09 2022] POST /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e/os-volume_attachments => generated 188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:36:09.852334 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e912b697-007c-474b-98d4-6d1aeaa8b0bd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:09.853152 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e912b697-007c-474b-98d4-6d1aeaa8b0bd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:09.860164 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e912b697-007c-474b-98d4-6d1aeaa8b0bd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:09.860922 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e912b697-007c-474b-98d4-6d1aeaa8b0bd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:09.861552 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e912b697-007c-474b-98d4-6d1aeaa8b0bd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:09.863019 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e912b697-007c-474b-98d4-6d1aeaa8b0bd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:09.863691 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e912b697-007c-474b-98d4-6d1aeaa8b0bd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:09.864308 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e912b697-007c-474b-98d4-6d1aeaa8b0bd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:10.117575 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e912b697-007c-474b-98d4-6d1aeaa8b0bd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e/os-volume_attachments/f6698a38-df59-4711-bde0-a60f38cacae4" status: 202 len: 0 microversion: 2.20 time: 0.269545 Sep 26 05:36:10.118172 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 447/870] 10.222.0.49 () {60 vars in 1457 bytes} [Mon Sep 26 05:36:09 2022] DELETE /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e/os-volume_attachments/f6698a38-df59-4711-bde0-a60f38cacae4 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:36:10.147323 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-95842bcf-d34c-4d08-8260-4df8d7679b70 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:10.148059 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-95842bcf-d34c-4d08-8260-4df8d7679b70 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:10.155030 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95842bcf-d34c-4d08-8260-4df8d7679b70 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:10.155699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95842bcf-d34c-4d08-8260-4df8d7679b70 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:10.156350 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95842bcf-d34c-4d08-8260-4df8d7679b70 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:10.157224 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95842bcf-d34c-4d08-8260-4df8d7679b70 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:10.157836 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95842bcf-d34c-4d08-8260-4df8d7679b70 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:10.159088 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95842bcf-d34c-4d08-8260-4df8d7679b70 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:10.182372 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-73d0aa45-67d7-4933-9c41-580c64d58fe3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:10.182993 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-73d0aa45-67d7-4933-9c41-580c64d58fe3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:10.189569 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-73d0aa45-67d7-4933-9c41-580c64d58fe3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:10.190100 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-73d0aa45-67d7-4933-9c41-580c64d58fe3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:10.190531 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-73d0aa45-67d7-4933-9c41-580c64d58fe3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:10.191227 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-73d0aa45-67d7-4933-9c41-580c64d58fe3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:10.191680 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-73d0aa45-67d7-4933-9c41-580c64d58fe3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:10.192109 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-73d0aa45-67d7-4933-9c41-580c64d58fe3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:10.227994 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-73d0aa45-67d7-4933-9c41-580c64d58fe3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120806) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 26 05:36:10.313932 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-73d0aa45-67d7-4933-9c41-580c64d58fe3 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "POST /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e/action" status: 202 len: 0 microversion: 2.20 time: 0.135266 Sep 26 05:36:10.317004 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 448/871] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Sep 26 05:36:10 2022] POST /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 26 05:36:10.326221 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-09cb58fe-d908-48c9-ae60-16d1ea98bafe tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:10.327867 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-09cb58fe-d908-48c9-ae60-16d1ea98bafe tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:10.338159 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-09cb58fe-d908-48c9-ae60-16d1ea98bafe tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:10.338836 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-09cb58fe-d908-48c9-ae60-16d1ea98bafe tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:10.339452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-09cb58fe-d908-48c9-ae60-16d1ea98bafe tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:10.340425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-09cb58fe-d908-48c9-ae60-16d1ea98bafe tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:10.341135 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-09cb58fe-d908-48c9-ae60-16d1ea98bafe tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:10.341833 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-09cb58fe-d908-48c9-ae60-16d1ea98bafe tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:10.383371 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-95842bcf-d34c-4d08-8260-4df8d7679b70 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:10.397479 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-95842bcf-d34c-4d08-8260-4df8d7679b70 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1362 microversion: 2.1 time: 0.252680 Sep 26 05:36:10.398281 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 424/872] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:10 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:10.410959 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-6eeea9c0-6491-4c59-83b5-96b0d1643ee5 req-c9bd9c79-f378-48c3-9470-377bea2fae5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e", "name": "network-vif-unplugged", "status": "completed", "tag": "d2d361e4-87bf-4197-9996-68e762a01ce3"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:10.429774 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-6eeea9c0-6491-4c59-83b5-96b0d1643ee5 req-c9bd9c79-f378-48c3-9470-377bea2fae5c service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:10.430523 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-6eeea9c0-6491-4c59-83b5-96b0d1643ee5 req-c9bd9c79-f378-48c3-9470-377bea2fae5c service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:10.431053 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-6eeea9c0-6491-4c59-83b5-96b0d1643ee5 req-c9bd9c79-f378-48c3-9470-377bea2fae5c service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:10.457036 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.compute.server_external_events [req-6eeea9c0-6491-4c59-83b5-96b0d1643ee5 req-c9bd9c79-f378-48c3-9470-377bea2fae5c service nova] Unable to find a host for instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e. Dropping event network-vif-unplugged {{(pid=120805) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 26 05:36:10.462238 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-6eeea9c0-6491-4c59-83b5-96b0d1643ee5 req-c9bd9c79-f378-48c3-9470-377bea2fae5c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.058040 Sep 26 05:36:10.463091 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 425/873] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 64 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 26 05:36:10.822028 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-09cb58fe-d908-48c9-ae60-16d1ea98bafe tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:10.830322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-09cb58fe-d908-48c9-ae60-16d1ea98bafe tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:10.831810 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-09cb58fe-d908-48c9-ae60-16d1ea98bafe tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:10.833181 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-09cb58fe-d908-48c9-ae60-16d1ea98bafe tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1672 microversion: 2.20 time: 0.511997 Sep 26 05:36:10.833738 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 449/874] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:10 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1672 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:11.425660 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f1fa68db-f248-4972-93d1-827e9c398b8d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:11.426397 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f1fa68db-f248-4972-93d1-827e9c398b8d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:11.428724 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=4 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:11.434296 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f1fa68db-f248-4972-93d1-827e9c398b8d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:11.434779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f1fa68db-f248-4972-93d1-827e9c398b8d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:11.435219 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f1fa68db-f248-4972-93d1-827e9c398b8d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:11.435905 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f1fa68db-f248-4972-93d1-827e9c398b8d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:11.436496 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f1fa68db-f248-4972-93d1-827e9c398b8d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:11.436925 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f1fa68db-f248-4972-93d1-827e9c398b8d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:11.570449 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f1fa68db-f248-4972-93d1-827e9c398b8d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:11.578593 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f1fa68db-f248-4972-93d1-827e9c398b8d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1362 microversion: 2.1 time: 0.157549 Sep 26 05:36:11.579154 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 426/875] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:11 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:11.860327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-382eefc5-a663-45e1-8817-c9d942b8e007 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:11.861152 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-382eefc5-a663-45e1-8817-c9d942b8e007 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:11.867387 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-382eefc5-a663-45e1-8817-c9d942b8e007 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:11.867878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-382eefc5-a663-45e1-8817-c9d942b8e007 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:11.868339 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-382eefc5-a663-45e1-8817-c9d942b8e007 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:11.869063 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-382eefc5-a663-45e1-8817-c9d942b8e007 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:11.869807 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-382eefc5-a663-45e1-8817-c9d942b8e007 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:11.869968 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-382eefc5-a663-45e1-8817-c9d942b8e007 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:12.072116 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-382eefc5-a663-45e1-8817-c9d942b8e007 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:12.080288 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-382eefc5-a663-45e1-8817-c9d942b8e007 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:12.081875 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-382eefc5-a663-45e1-8817-c9d942b8e007 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:12.083047 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-382eefc5-a663-45e1-8817-c9d942b8e007 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1730 microversion: 2.20 time: 0.228028 Sep 26 05:36:12.083597 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 450/876] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:11 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1730 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:12.602851 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7bc3a069-cce7-4d34-a2c1-efd61c8b2050 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:12.603535 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7bc3a069-cce7-4d34-a2c1-efd61c8b2050 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:12.610371 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bc3a069-cce7-4d34-a2c1-efd61c8b2050 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:12.610857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bc3a069-cce7-4d34-a2c1-efd61c8b2050 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:12.611295 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bc3a069-cce7-4d34-a2c1-efd61c8b2050 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:12.612013 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bc3a069-cce7-4d34-a2c1-efd61c8b2050 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:12.612488 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bc3a069-cce7-4d34-a2c1-efd61c8b2050 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:12.612916 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bc3a069-cce7-4d34-a2c1-efd61c8b2050 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:12.758477 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7bc3a069-cce7-4d34-a2c1-efd61c8b2050 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:12.767510 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7bc3a069-cce7-4d34-a2c1-efd61c8b2050 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1362 microversion: 2.1 time: 0.168738 Sep 26 05:36:12.775338 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 427/877] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:12 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:13.110280 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-12fada34-e14a-40a4-a3da-204b0c9132c2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:13.112385 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-12fada34-e14a-40a4-a3da-204b0c9132c2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:13.121520 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-12fada34-e14a-40a4-a3da-204b0c9132c2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:13.128870 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-12fada34-e14a-40a4-a3da-204b0c9132c2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:13.129892 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-12fada34-e14a-40a4-a3da-204b0c9132c2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:13.131537 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-12fada34-e14a-40a4-a3da-204b0c9132c2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:13.132473 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-12fada34-e14a-40a4-a3da-204b0c9132c2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:13.133509 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-12fada34-e14a-40a4-a3da-204b0c9132c2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:13.350598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-12fada34-e14a-40a4-a3da-204b0c9132c2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:13.359468 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-12fada34-e14a-40a4-a3da-204b0c9132c2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:13.361055 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-12fada34-e14a-40a4-a3da-204b0c9132c2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:13.362988 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-12fada34-e14a-40a4-a3da-204b0c9132c2 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1730 microversion: 2.20 time: 0.257473 Sep 26 05:36:13.380674 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 451/878] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:13 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1730 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:13.790840 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-95d6c2fd-a9db-4b31-b537-b8eaa8a000f3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:13.791448 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-95d6c2fd-a9db-4b31-b537-b8eaa8a000f3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:13.798042 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95d6c2fd-a9db-4b31-b537-b8eaa8a000f3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:13.798532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95d6c2fd-a9db-4b31-b537-b8eaa8a000f3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:13.799656 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95d6c2fd-a9db-4b31-b537-b8eaa8a000f3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:13.800652 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95d6c2fd-a9db-4b31-b537-b8eaa8a000f3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:13.801122 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95d6c2fd-a9db-4b31-b537-b8eaa8a000f3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:13.801556 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95d6c2fd-a9db-4b31-b537-b8eaa8a000f3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:13.942918 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-95d6c2fd-a9db-4b31-b537-b8eaa8a000f3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:13.953695 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-95d6c2fd-a9db-4b31-b537-b8eaa8a000f3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1362 microversion: 2.1 time: 0.166636 Sep 26 05:36:13.954521 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 428/879] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:13 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:14.390752 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c1fe489e-fdfe-4c83-8369-aa0d2bcfb538 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:14.391476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c1fe489e-fdfe-4c83-8369-aa0d2bcfb538 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:14.395609 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:14.402214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c1fe489e-fdfe-4c83-8369-aa0d2bcfb538 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:14.403045 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c1fe489e-fdfe-4c83-8369-aa0d2bcfb538 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:14.403713 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c1fe489e-fdfe-4c83-8369-aa0d2bcfb538 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:14.406995 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c1fe489e-fdfe-4c83-8369-aa0d2bcfb538 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:14.407635 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c1fe489e-fdfe-4c83-8369-aa0d2bcfb538 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:14.425858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c1fe489e-fdfe-4c83-8369-aa0d2bcfb538 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:14.445448 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=8 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:14.472474 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-a80fa1f3-cd30-4c0f-a3d4-27b18d660e20 req-564d4fbc-d86d-4aff-a769-894f8adfeb06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ae32da-8cf7-4b65-9387-3d013453dbe5", "name": "network-vif-plugged", "status": "completed", "tag": "5c2eb711-a069-49dc-aca7-800571583c6a"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:14.495505 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-a80fa1f3-cd30-4c0f-a3d4-27b18d660e20 req-564d4fbc-d86d-4aff-a769-894f8adfeb06 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:14.497771 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-a80fa1f3-cd30-4c0f-a3d4-27b18d660e20 req-564d4fbc-d86d-4aff-a769-894f8adfeb06 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:14.498315 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-a80fa1f3-cd30-4c0f-a3d4-27b18d660e20 req-564d4fbc-d86d-4aff-a769-894f8adfeb06 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:14.527056 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-a80fa1f3-cd30-4c0f-a3d4-27b18d660e20 req-564d4fbc-d86d-4aff-a769-894f8adfeb06 service nova] Creating event network-vif-plugged:5c2eb711-a069-49dc-aca7-800571583c6a for instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 on hv-cinder-85918 Sep 26 05:36:14.541077 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-a80fa1f3-cd30-4c0f-a3d4-27b18d660e20 req-564d4fbc-d86d-4aff-a769-894f8adfeb06 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071547 Sep 26 05:36:14.541723 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 429/880] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:36:14.674116 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-c1fe489e-fdfe-4c83-8369-aa0d2bcfb538 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:14.683079 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-c1fe489e-fdfe-4c83-8369-aa0d2bcfb538 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:14.684540 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-c1fe489e-fdfe-4c83-8369-aa0d2bcfb538 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:14.686117 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c1fe489e-fdfe-4c83-8369-aa0d2bcfb538 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1730 microversion: 2.20 time: 0.299588 Sep 26 05:36:14.686685 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 452/881] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:14 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1730 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:14.979163 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fa52167a-d880-4e0b-adf4-6c77cd0197a6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:14.981276 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fa52167a-d880-4e0b-adf4-6c77cd0197a6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:14.988867 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fa52167a-d880-4e0b-adf4-6c77cd0197a6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:14.989429 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fa52167a-d880-4e0b-adf4-6c77cd0197a6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:14.989871 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fa52167a-d880-4e0b-adf4-6c77cd0197a6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:14.990742 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fa52167a-d880-4e0b-adf4-6c77cd0197a6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:14.991222 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fa52167a-d880-4e0b-adf4-6c77cd0197a6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:14.991676 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fa52167a-d880-4e0b-adf4-6c77cd0197a6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:15.150969 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fa52167a-d880-4e0b-adf4-6c77cd0197a6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:15.159077 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fa52167a-d880-4e0b-adf4-6c77cd0197a6 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1362 microversion: 2.1 time: 0.184262 Sep 26 05:36:15.159655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 430/882] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:14 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:15.715007 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b05deb9a-aa46-46fb-bb39-1da390e6ed4d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:15.715643 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b05deb9a-aa46-46fb-bb39-1da390e6ed4d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:15.722523 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b05deb9a-aa46-46fb-bb39-1da390e6ed4d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:15.723000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b05deb9a-aa46-46fb-bb39-1da390e6ed4d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:15.723455 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b05deb9a-aa46-46fb-bb39-1da390e6ed4d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:15.724142 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b05deb9a-aa46-46fb-bb39-1da390e6ed4d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:15.724877 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b05deb9a-aa46-46fb-bb39-1da390e6ed4d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:15.725306 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b05deb9a-aa46-46fb-bb39-1da390e6ed4d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:15.883904 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b05deb9a-aa46-46fb-bb39-1da390e6ed4d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:15.887035 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:15.904913 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b05deb9a-aa46-46fb-bb39-1da390e6ed4d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:15.906380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b05deb9a-aa46-46fb-bb39-1da390e6ed4d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:15.911506 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b05deb9a-aa46-46fb-bb39-1da390e6ed4d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1730 microversion: 2.20 time: 0.200037 Sep 26 05:36:15.912539 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 453/883] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:15 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:16.181910 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-55ac440b-edcb-45f5-b3f6-1af5ba5f1631 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:16.182661 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-55ac440b-edcb-45f5-b3f6-1af5ba5f1631 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:16.189194 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-55ac440b-edcb-45f5-b3f6-1af5ba5f1631 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:16.189922 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-55ac440b-edcb-45f5-b3f6-1af5ba5f1631 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:16.190384 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-55ac440b-edcb-45f5-b3f6-1af5ba5f1631 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:16.191067 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-55ac440b-edcb-45f5-b3f6-1af5ba5f1631 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:16.191517 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-55ac440b-edcb-45f5-b3f6-1af5ba5f1631 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:16.191937 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-55ac440b-edcb-45f5-b3f6-1af5ba5f1631 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:16.336442 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-55ac440b-edcb-45f5-b3f6-1af5ba5f1631 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:16.345187 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-55ac440b-edcb-45f5-b3f6-1af5ba5f1631 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1362 microversion: 2.1 time: 0.167176 Sep 26 05:36:16.346618 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 431/884] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:16 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:16.938584 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-8c4004d3-61e1-4d2b-8c70-2699a5a24d73 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:16.940021 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-8c4004d3-61e1-4d2b-8c70-2699a5a24d73 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:16.947807 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8c4004d3-61e1-4d2b-8c70-2699a5a24d73 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:16.948678 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8c4004d3-61e1-4d2b-8c70-2699a5a24d73 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:16.949360 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8c4004d3-61e1-4d2b-8c70-2699a5a24d73 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:16.950293 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8c4004d3-61e1-4d2b-8c70-2699a5a24d73 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:16.951235 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8c4004d3-61e1-4d2b-8c70-2699a5a24d73 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:16.951870 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8c4004d3-61e1-4d2b-8c70-2699a5a24d73 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:17.200407 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8c4004d3-61e1-4d2b-8c70-2699a5a24d73 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:17.212085 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8c4004d3-61e1-4d2b-8c70-2699a5a24d73 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:17.214184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8c4004d3-61e1-4d2b-8c70-2699a5a24d73 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:17.215755 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-8c4004d3-61e1-4d2b-8c70-2699a5a24d73 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1730 microversion: 2.20 time: 0.282073 Sep 26 05:36:17.217092 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 454/885] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:16 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1730 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:17.369382 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-801a83e4-cc0b-4767-80f1-a2a31ca1edd9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:17.369990 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-801a83e4-cc0b-4767-80f1-a2a31ca1edd9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:17.376786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-801a83e4-cc0b-4767-80f1-a2a31ca1edd9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:17.377432 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-801a83e4-cc0b-4767-80f1-a2a31ca1edd9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:17.377877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-801a83e4-cc0b-4767-80f1-a2a31ca1edd9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:17.378585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-801a83e4-cc0b-4767-80f1-a2a31ca1edd9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:17.379120 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-801a83e4-cc0b-4767-80f1-a2a31ca1edd9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:17.379616 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-801a83e4-cc0b-4767-80f1-a2a31ca1edd9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:17.566379 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-801a83e4-cc0b-4767-80f1-a2a31ca1edd9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:17.574627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-801a83e4-cc0b-4767-80f1-a2a31ca1edd9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1362 microversion: 2.1 time: 0.209032 Sep 26 05:36:17.575729 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 432/886] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:17 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:18.242950 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7bd26d01-827a-4cf1-bff8-0de8c96744fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:18.243671 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7bd26d01-827a-4cf1-bff8-0de8c96744fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:18.250141 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7bd26d01-827a-4cf1-bff8-0de8c96744fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:18.250696 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7bd26d01-827a-4cf1-bff8-0de8c96744fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:18.251194 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7bd26d01-827a-4cf1-bff8-0de8c96744fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:18.252806 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7bd26d01-827a-4cf1-bff8-0de8c96744fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:18.253428 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7bd26d01-827a-4cf1-bff8-0de8c96744fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:18.254065 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7bd26d01-827a-4cf1-bff8-0de8c96744fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:18.286168 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d1b2756a-7b8f-41fe-978d-11f1df7d3246 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:18.286663 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d1b2756a-7b8f-41fe-978d-11f1df7d3246 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:18.292839 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1b2756a-7b8f-41fe-978d-11f1df7d3246 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:18.293365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1b2756a-7b8f-41fe-978d-11f1df7d3246 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:18.293994 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1b2756a-7b8f-41fe-978d-11f1df7d3246 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:18.294885 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1b2756a-7b8f-41fe-978d-11f1df7d3246 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:18.295551 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1b2756a-7b8f-41fe-978d-11f1df7d3246 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:18.296165 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1b2756a-7b8f-41fe-978d-11f1df7d3246 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:18.343117 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d1b2756a-7b8f-41fe-978d-11f1df7d3246 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d/ips" status: 200 len: 151 microversion: 2.1 time: 0.060990 Sep 26 05:36:18.344035 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 433/887] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 05:36:18 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d/ips => generated 151 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:36:18.397911 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7bd26d01-827a-4cf1-bff8-0de8c96744fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:18.407055 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7bd26d01-827a-4cf1-bff8-0de8c96744fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:18.408674 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7bd26d01-827a-4cf1-bff8-0de8c96744fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:18.409950 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7bd26d01-827a-4cf1-bff8-0de8c96744fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1730 microversion: 2.20 time: 0.171018 Sep 26 05:36:18.410841 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 455/888] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:18 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:36:18.602045 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2f2dc678-6b26-4a8b-b9c6-699e23893e5b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:18.604055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2f2dc678-6b26-4a8b-b9c6-699e23893e5b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:18.612060 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f2dc678-6b26-4a8b-b9c6-699e23893e5b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:18.612577 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f2dc678-6b26-4a8b-b9c6-699e23893e5b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:18.613011 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f2dc678-6b26-4a8b-b9c6-699e23893e5b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:18.613707 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f2dc678-6b26-4a8b-b9c6-699e23893e5b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:18.614157 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f2dc678-6b26-4a8b-b9c6-699e23893e5b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:18.614580 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f2dc678-6b26-4a8b-b9c6-699e23893e5b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:18.799023 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2f2dc678-6b26-4a8b-b9c6-699e23893e5b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:18.807856 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2f2dc678-6b26-4a8b-b9c6-699e23893e5b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1362 microversion: 2.1 time: 0.209919 Sep 26 05:36:18.837623 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 434/889] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:18 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:19.435933 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-2a81f144-6ae8-4d90-b951-e16a7a5cfad5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:19.437383 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-2a81f144-6ae8-4d90-b951-e16a7a5cfad5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:19.459309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2a81f144-6ae8-4d90-b951-e16a7a5cfad5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:19.460195 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2a81f144-6ae8-4d90-b951-e16a7a5cfad5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:19.460903 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2a81f144-6ae8-4d90-b951-e16a7a5cfad5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:19.467389 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2a81f144-6ae8-4d90-b951-e16a7a5cfad5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:19.468209 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2a81f144-6ae8-4d90-b951-e16a7a5cfad5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:19.468924 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2a81f144-6ae8-4d90-b951-e16a7a5cfad5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:19.666724 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2a81f144-6ae8-4d90-b951-e16a7a5cfad5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:19.677689 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2a81f144-6ae8-4d90-b951-e16a7a5cfad5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:19.679795 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2a81f144-6ae8-4d90-b951-e16a7a5cfad5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:19.681305 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2a81f144-6ae8-4d90-b951-e16a7a5cfad5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1730 microversion: 2.20 time: 0.249737 Sep 26 05:36:19.684355 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 456/890] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:19 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1730 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:19.789368 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1a24796c-2c90-4ab0-bffe-6c249a01cbd4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "221d18a0-92d9-479f-b0bc-0f2e1c5e8f1a"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:19.792100 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1a24796c-2c90-4ab0-bffe-6c249a01cbd4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:19.813641 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1a24796c-2c90-4ab0-bffe-6c249a01cbd4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:19.818077 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1a24796c-2c90-4ab0-bffe-6c249a01cbd4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:19.818943 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1a24796c-2c90-4ab0-bffe-6c249a01cbd4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:19.820015 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1a24796c-2c90-4ab0-bffe-6c249a01cbd4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:19.820794 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1a24796c-2c90-4ab0-bffe-6c249a01cbd4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:19.826678 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1a24796c-2c90-4ab0-bffe-6c249a01cbd4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:19.838196 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-70e37297-7160-497b-a97d-24b85240ef85 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:19.838960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-70e37297-7160-497b-a97d-24b85240ef85 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:19.848423 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-70e37297-7160-497b-a97d-24b85240ef85 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:19.848915 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-70e37297-7160-497b-a97d-24b85240ef85 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:19.855098 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-70e37297-7160-497b-a97d-24b85240ef85 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:19.856206 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-70e37297-7160-497b-a97d-24b85240ef85 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:19.857206 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-70e37297-7160-497b-a97d-24b85240ef85 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:19.857867 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-70e37297-7160-497b-a97d-24b85240ef85 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:20.117212 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-70e37297-7160-497b-a97d-24b85240ef85 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:20.133696 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-70e37297-7160-497b-a97d-24b85240ef85 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1362 microversion: 2.1 time: 0.299676 Sep 26 05:36:20.134433 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 457/891] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:19 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:36:20.714950 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-44a42e26-b939-4915-bc53-239714f2ec74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:20.715782 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-44a42e26-b939-4915-bc53-239714f2ec74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:20.723327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-44a42e26-b939-4915-bc53-239714f2ec74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:20.723822 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-44a42e26-b939-4915-bc53-239714f2ec74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:20.724532 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-44a42e26-b939-4915-bc53-239714f2ec74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:20.725436 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-44a42e26-b939-4915-bc53-239714f2ec74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:20.726201 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-44a42e26-b939-4915-bc53-239714f2ec74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:20.726343 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-44a42e26-b939-4915-bc53-239714f2ec74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:20.931842 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-44a42e26-b939-4915-bc53-239714f2ec74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:20.941791 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-44a42e26-b939-4915-bc53-239714f2ec74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:20.943261 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-44a42e26-b939-4915-bc53-239714f2ec74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:20.944487 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-44a42e26-b939-4915-bc53-239714f2ec74 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1730 microversion: 2.20 time: 0.233971 Sep 26 05:36:20.956423 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 458/892] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:20 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1730 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:21.157319 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f3e1a25d-4f88-4771-a790-3804ed6292db tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:21.158874 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f3e1a25d-4f88-4771-a790-3804ed6292db tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:21.165443 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f3e1a25d-4f88-4771-a790-3804ed6292db tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:21.165964 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f3e1a25d-4f88-4771-a790-3804ed6292db tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:21.166510 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f3e1a25d-4f88-4771-a790-3804ed6292db tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:21.167250 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f3e1a25d-4f88-4771-a790-3804ed6292db tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:21.167730 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f3e1a25d-4f88-4771-a790-3804ed6292db tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:21.168192 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f3e1a25d-4f88-4771-a790-3804ed6292db tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:21.301759 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f3e1a25d-4f88-4771-a790-3804ed6292db tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:21.309452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f3e1a25d-4f88-4771-a790-3804ed6292db tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1362 microversion: 2.1 time: 0.156049 Sep 26 05:36:21.310286 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 459/893] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:21 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:36:21.969668 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-174ecee1-150f-4f13-8dba-312fa7964edf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:21.970444 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-174ecee1-150f-4f13-8dba-312fa7964edf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:21.977375 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-174ecee1-150f-4f13-8dba-312fa7964edf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:21.977928 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-174ecee1-150f-4f13-8dba-312fa7964edf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:21.978392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-174ecee1-150f-4f13-8dba-312fa7964edf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:21.979079 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-174ecee1-150f-4f13-8dba-312fa7964edf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:21.979528 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-174ecee1-150f-4f13-8dba-312fa7964edf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:21.979954 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-174ecee1-150f-4f13-8dba-312fa7964edf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:22.122104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-174ecee1-150f-4f13-8dba-312fa7964edf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:22.131228 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-174ecee1-150f-4f13-8dba-312fa7964edf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:22.132685 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-174ecee1-150f-4f13-8dba-312fa7964edf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:22.133907 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-174ecee1-150f-4f13-8dba-312fa7964edf tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1730 microversion: 2.20 time: 0.168043 Sep 26 05:36:22.136414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 460/894] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:21 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:36:22.333099 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e1167141-4c55-40ab-a95e-9a9356458769 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:22.334096 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e1167141-4c55-40ab-a95e-9a9356458769 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:22.339856 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e1167141-4c55-40ab-a95e-9a9356458769 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:22.340426 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e1167141-4c55-40ab-a95e-9a9356458769 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:22.340894 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e1167141-4c55-40ab-a95e-9a9356458769 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:22.341541 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e1167141-4c55-40ab-a95e-9a9356458769 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:22.342005 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e1167141-4c55-40ab-a95e-9a9356458769 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:22.342414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e1167141-4c55-40ab-a95e-9a9356458769 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:22.493890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e1167141-4c55-40ab-a95e-9a9356458769 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:22.503046 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e1167141-4c55-40ab-a95e-9a9356458769 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1362 microversion: 2.1 time: 0.173797 Sep 26 05:36:22.503871 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 461/895] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:22 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:36:22.682956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1a24796c-2c90-4ab0-bffe-6c249a01cbd4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "POST /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.898658 Sep 26 05:36:22.683593 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 435/896] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 05:36:19 2022] POST /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d/os-volume_attachments => generated 194 bytes in 2901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:36:23.160047 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-09da29d7-9d22-4b14-97b8-6a64611ad8c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:23.160828 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-09da29d7-9d22-4b14-97b8-6a64611ad8c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:23.167280 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-09da29d7-9d22-4b14-97b8-6a64611ad8c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:23.167766 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-09da29d7-9d22-4b14-97b8-6a64611ad8c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:23.168196 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-09da29d7-9d22-4b14-97b8-6a64611ad8c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:23.168909 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-09da29d7-9d22-4b14-97b8-6a64611ad8c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:23.169356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-09da29d7-9d22-4b14-97b8-6a64611ad8c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:23.169777 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-09da29d7-9d22-4b14-97b8-6a64611ad8c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:23.309713 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-09da29d7-9d22-4b14-97b8-6a64611ad8c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:23.318776 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-09da29d7-9d22-4b14-97b8-6a64611ad8c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:23.320225 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-09da29d7-9d22-4b14-97b8-6a64611ad8c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:23.321446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-09da29d7-9d22-4b14-97b8-6a64611ad8c4 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1730 microversion: 2.20 time: 0.166401 Sep 26 05:36:23.321995 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 462/897] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:23 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:23.528648 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-362758e5-3b3d-4842-b3e7-542ba00f171b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:23.529562 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-362758e5-3b3d-4842-b3e7-542ba00f171b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:23.537341 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-362758e5-3b3d-4842-b3e7-542ba00f171b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:23.538076 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-362758e5-3b3d-4842-b3e7-542ba00f171b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:23.538681 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-362758e5-3b3d-4842-b3e7-542ba00f171b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:23.539559 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-362758e5-3b3d-4842-b3e7-542ba00f171b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:23.540189 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-362758e5-3b3d-4842-b3e7-542ba00f171b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:23.540793 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-362758e5-3b3d-4842-b3e7-542ba00f171b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:23.702815 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-362758e5-3b3d-4842-b3e7-542ba00f171b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:23.710715 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-362758e5-3b3d-4842-b3e7-542ba00f171b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1362 microversion: 2.1 time: 0.187716 Sep 26 05:36:23.711220 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 436/898] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:23 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:24.347208 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9ab66d6c-3ba9-4e87-bb9c-e852375de4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:24.347747 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-9ab66d6c-3ba9-4e87-bb9c-e852375de4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:24.354348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9ab66d6c-3ba9-4e87-bb9c-e852375de4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:24.354849 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9ab66d6c-3ba9-4e87-bb9c-e852375de4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:24.355290 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9ab66d6c-3ba9-4e87-bb9c-e852375de4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:24.356009 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9ab66d6c-3ba9-4e87-bb9c-e852375de4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:24.356516 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9ab66d6c-3ba9-4e87-bb9c-e852375de4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:24.356941 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9ab66d6c-3ba9-4e87-bb9c-e852375de4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:24.510439 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-9ab66d6c-3ba9-4e87-bb9c-e852375de4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:24.520012 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-9ab66d6c-3ba9-4e87-bb9c-e852375de4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:24.521534 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-9ab66d6c-3ba9-4e87-bb9c-e852375de4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:24.522948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-9ab66d6c-3ba9-4e87-bb9c-e852375de4c1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1730 microversion: 2.20 time: 0.179843 Sep 26 05:36:24.530756 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 463/899] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:24 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:24.733859 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-34fb5196-b3b9-442e-b676-ae828e01bda9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:24.734500 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-34fb5196-b3b9-442e-b676-ae828e01bda9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:24.741841 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-34fb5196-b3b9-442e-b676-ae828e01bda9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:24.742336 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-34fb5196-b3b9-442e-b676-ae828e01bda9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:24.742780 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-34fb5196-b3b9-442e-b676-ae828e01bda9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:24.743489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-34fb5196-b3b9-442e-b676-ae828e01bda9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:24.743961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-34fb5196-b3b9-442e-b676-ae828e01bda9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:24.744429 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-34fb5196-b3b9-442e-b676-ae828e01bda9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:24.889805 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-34fb5196-b3b9-442e-b676-ae828e01bda9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:24.892391 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:24.899822 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-34fb5196-b3b9-442e-b676-ae828e01bda9 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1546 microversion: 2.1 time: 0.169862 Sep 26 05:36:24.900541 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 437/900] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:24 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1546 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:24.922440 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9aaf9558-8810-4174-982c-8422c36e780b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:24.922953 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-9aaf9558-8810-4174-982c-8422c36e780b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:24.929832 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9aaf9558-8810-4174-982c-8422c36e780b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:24.930348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9aaf9558-8810-4174-982c-8422c36e780b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:24.930791 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9aaf9558-8810-4174-982c-8422c36e780b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:24.931477 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9aaf9558-8810-4174-982c-8422c36e780b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:24.931934 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9aaf9558-8810-4174-982c-8422c36e780b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:24.932391 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9aaf9558-8810-4174-982c-8422c36e780b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:25.007640 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-9aaf9558-8810-4174-982c-8422c36e780b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088975 Sep 26 05:36:25.008232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 464/901] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 05:36:24 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:36:25.555600 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a3c79fca-e23c-489a-b480-8b338cadb55d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:25.556242 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a3c79fca-e23c-489a-b480-8b338cadb55d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:25.564352 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a3c79fca-e23c-489a-b480-8b338cadb55d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:25.564855 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a3c79fca-e23c-489a-b480-8b338cadb55d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:25.565298 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a3c79fca-e23c-489a-b480-8b338cadb55d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:25.565996 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a3c79fca-e23c-489a-b480-8b338cadb55d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:25.566460 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a3c79fca-e23c-489a-b480-8b338cadb55d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:25.566891 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a3c79fca-e23c-489a-b480-8b338cadb55d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:25.801480 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a3c79fca-e23c-489a-b480-8b338cadb55d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:25.809545 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a3c79fca-e23c-489a-b480-8b338cadb55d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:25.811250 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a3c79fca-e23c-489a-b480-8b338cadb55d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:25.812289 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a3c79fca-e23c-489a-b480-8b338cadb55d tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1730 microversion: 2.20 time: 0.260636 Sep 26 05:36:25.812840 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 438/902] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:25 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1730 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:26.017132 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-10068add-9611-4d46-8ce1-0ff1b4ad9b97 req-12e55d6c-1cf4-4c25-b570-c1b3de02197f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69ae32da-8cf7-4b65-9387-3d013453dbe5", "tag": "5c2eb711-a069-49dc-aca7-800571583c6a"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:26.027423 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-10068add-9611-4d46-8ce1-0ff1b4ad9b97 req-12e55d6c-1cf4-4c25-b570-c1b3de02197f service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:26.027891 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-10068add-9611-4d46-8ce1-0ff1b4ad9b97 req-12e55d6c-1cf4-4c25-b570-c1b3de02197f service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:26.028365 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-10068add-9611-4d46-8ce1-0ff1b4ad9b97 req-12e55d6c-1cf4-4c25-b570-c1b3de02197f service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:26.039182 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-10068add-9611-4d46-8ce1-0ff1b4ad9b97 req-12e55d6c-1cf4-4c25-b570-c1b3de02197f service nova] Creating event network-changed:5c2eb711-a069-49dc-aca7-800571583c6a for instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 on hv-cinder-85918 Sep 26 05:36:26.044312 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-10068add-9611-4d46-8ce1-0ff1b4ad9b97 req-12e55d6c-1cf4-4c25-b570-c1b3de02197f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031484 Sep 26 05:36:26.045210 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 465/903] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:36:26.673295 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-636a113b-5f8e-4802-87cc-598d58ad0d71 req-44219204-e05e-439d-93e4-3f06bfe8f19a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e", "name": "network-vif-plugged", "status": "completed", "tag": "d2d361e4-87bf-4197-9996-68e762a01ce3"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:26.685661 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-636a113b-5f8e-4802-87cc-598d58ad0d71 req-44219204-e05e-439d-93e4-3f06bfe8f19a service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:26.686296 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-636a113b-5f8e-4802-87cc-598d58ad0d71 req-44219204-e05e-439d-93e4-3f06bfe8f19a service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:26.686821 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-636a113b-5f8e-4802-87cc-598d58ad0d71 req-44219204-e05e-439d-93e4-3f06bfe8f19a service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:26.701172 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-636a113b-5f8e-4802-87cc-598d58ad0d71 req-44219204-e05e-439d-93e4-3f06bfe8f19a service nova] Creating event network-vif-plugged:d2d361e4-87bf-4197-9996-68e762a01ce3 for instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e on hv-cinder-85918 Sep 26 05:36:26.708720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-636a113b-5f8e-4802-87cc-598d58ad0d71 req-44219204-e05e-439d-93e4-3f06bfe8f19a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040116 Sep 26 05:36:26.709978 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 439/904] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:36:26.841868 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7033f035-afd6-444e-b870-949479e169cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:26.842676 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7033f035-afd6-444e-b870-949479e169cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:26.856982 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7033f035-afd6-444e-b870-949479e169cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:26.857884 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7033f035-afd6-444e-b870-949479e169cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:26.859603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7033f035-afd6-444e-b870-949479e169cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:26.861089 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7033f035-afd6-444e-b870-949479e169cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:26.861874 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7033f035-afd6-444e-b870-949479e169cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:26.862631 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7033f035-afd6-444e-b870-949479e169cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:27.067897 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7033f035-afd6-444e-b870-949479e169cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:27.076196 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7033f035-afd6-444e-b870-949479e169cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:27.077726 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7033f035-afd6-444e-b870-949479e169cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:27.078945 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7033f035-afd6-444e-b870-949479e169cd tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1730 microversion: 2.20 time: 0.243976 Sep 26 05:36:27.080065 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 466/905] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:26 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1730 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:28.105830 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f3c503f8-810a-4ce4-aa9e-41faa778d0fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:28.106553 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f3c503f8-810a-4ce4-aa9e-41faa778d0fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:28.113124 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f3c503f8-810a-4ce4-aa9e-41faa778d0fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:28.113608 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f3c503f8-810a-4ce4-aa9e-41faa778d0fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:28.114038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f3c503f8-810a-4ce4-aa9e-41faa778d0fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:28.114724 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f3c503f8-810a-4ce4-aa9e-41faa778d0fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:28.115170 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f3c503f8-810a-4ce4-aa9e-41faa778d0fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:28.115633 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f3c503f8-810a-4ce4-aa9e-41faa778d0fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:28.249483 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f3c503f8-810a-4ce4-aa9e-41faa778d0fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:28.258463 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f3c503f8-810a-4ce4-aa9e-41faa778d0fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:28.260030 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f3c503f8-810a-4ce4-aa9e-41faa778d0fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:28.261267 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f3c503f8-810a-4ce4-aa9e-41faa778d0fc tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1730 microversion: 2.20 time: 0.160301 Sep 26 05:36:28.261825 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 440/906] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:28 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:29.287465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7a40444c-acac-4f4d-a35a-eed468beb6fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:29.288862 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7a40444c-acac-4f4d-a35a-eed468beb6fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:29.295762 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7a40444c-acac-4f4d-a35a-eed468beb6fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:29.296275 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7a40444c-acac-4f4d-a35a-eed468beb6fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:29.296876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7a40444c-acac-4f4d-a35a-eed468beb6fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:29.297569 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7a40444c-acac-4f4d-a35a-eed468beb6fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:29.298075 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7a40444c-acac-4f4d-a35a-eed468beb6fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:29.298715 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7a40444c-acac-4f4d-a35a-eed468beb6fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:29.434982 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7a40444c-acac-4f4d-a35a-eed468beb6fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:29.443343 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7a40444c-acac-4f4d-a35a-eed468beb6fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:29.444827 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7a40444c-acac-4f4d-a35a-eed468beb6fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:29.445975 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7a40444c-acac-4f4d-a35a-eed468beb6fa tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1730 microversion: 2.20 time: 0.162909 Sep 26 05:36:29.446614 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 467/907] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:29 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:30.472164 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-60f3978f-7c19-4fc0-a867-d402d7d83550 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:30.472794 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-60f3978f-7c19-4fc0-a867-d402d7d83550 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:30.479492 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-60f3978f-7c19-4fc0-a867-d402d7d83550 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:30.479970 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-60f3978f-7c19-4fc0-a867-d402d7d83550 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:30.480438 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-60f3978f-7c19-4fc0-a867-d402d7d83550 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:30.481121 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-60f3978f-7c19-4fc0-a867-d402d7d83550 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:30.481573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-60f3978f-7c19-4fc0-a867-d402d7d83550 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:30.481994 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-60f3978f-7c19-4fc0-a867-d402d7d83550 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:30.612221 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-60f3978f-7c19-4fc0-a867-d402d7d83550 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:30.621300 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-60f3978f-7c19-4fc0-a867-d402d7d83550 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:30.622746 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-60f3978f-7c19-4fc0-a867-d402d7d83550 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:30.623902 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-60f3978f-7c19-4fc0-a867-d402d7d83550 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1717 microversion: 2.20 time: 0.156326 Sep 26 05:36:30.624496 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 441/908] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:36:30 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:36:31.430727 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-90852308-aaad-409e-b629-e20a56b35cf4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:31.431232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-90852308-aaad-409e-b629-e20a56b35cf4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:31.437566 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-90852308-aaad-409e-b629-e20a56b35cf4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:31.438042 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-90852308-aaad-409e-b629-e20a56b35cf4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:31.439092 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-90852308-aaad-409e-b629-e20a56b35cf4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:31.439780 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-90852308-aaad-409e-b629-e20a56b35cf4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:31.440226 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-90852308-aaad-409e-b629-e20a56b35cf4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:31.440668 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-90852308-aaad-409e-b629-e20a56b35cf4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:31.520781 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-90852308-aaad-409e-b629-e20a56b35cf4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lazy-loading 'services' on Instance uuid acd42d52-e8d1-447f-882e-7151c7010c2d {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:36:31.590138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-90852308-aaad-409e-b629-e20a56b35cf4 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "DELETE /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d/os-volume_attachments/221d18a0-92d9-479f-b0bc-0f2e1c5e8f1a" status: 202 len: 0 microversion: 2.1 time: 0.163112 Sep 26 05:36:31.590720 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 468/909] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 05:36:31 2022] DELETE /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d/os-volume_attachments/221d18a0-92d9-479f-b0bc-0f2e1c5e8f1a => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:36:31.599540 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5371f0c6-7be7-4509-b5a1-0c68caf3f690 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:31.601916 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5371f0c6-7be7-4509-b5a1-0c68caf3f690 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:31.608365 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5371f0c6-7be7-4509-b5a1-0c68caf3f690 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:31.608847 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5371f0c6-7be7-4509-b5a1-0c68caf3f690 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:31.609285 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5371f0c6-7be7-4509-b5a1-0c68caf3f690 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:31.609969 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5371f0c6-7be7-4509-b5a1-0c68caf3f690 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:31.610507 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5371f0c6-7be7-4509-b5a1-0c68caf3f690 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:31.611095 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5371f0c6-7be7-4509-b5a1-0c68caf3f690 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:31.644532 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5371f0c6-7be7-4509-b5a1-0c68caf3f690 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049267 Sep 26 05:36:31.645580 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 442/910] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:36:31 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:36:32.659895 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1c6d4848-e5ff-48a9-b2f7-06a141c40735 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:32.662145 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-1c6d4848-e5ff-48a9-b2f7-06a141c40735 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:32.668306 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1c6d4848-e5ff-48a9-b2f7-06a141c40735 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:32.668787 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1c6d4848-e5ff-48a9-b2f7-06a141c40735 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:32.669215 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1c6d4848-e5ff-48a9-b2f7-06a141c40735 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:32.669893 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1c6d4848-e5ff-48a9-b2f7-06a141c40735 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:32.670338 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1c6d4848-e5ff-48a9-b2f7-06a141c40735 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:32.670757 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1c6d4848-e5ff-48a9-b2f7-06a141c40735 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:32.699512 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1c6d4848-e5ff-48a9-b2f7-06a141c40735 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045131 Sep 26 05:36:32.700050 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 469/911] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:36:32 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:36:33.712596 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ad7e7dd6-bc90-4ec0-af80-361b3a8f3c44 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:33.714886 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ad7e7dd6-bc90-4ec0-af80-361b3a8f3c44 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:33.721947 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ad7e7dd6-bc90-4ec0-af80-361b3a8f3c44 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:33.722437 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ad7e7dd6-bc90-4ec0-af80-361b3a8f3c44 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:33.722876 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ad7e7dd6-bc90-4ec0-af80-361b3a8f3c44 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:33.723599 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ad7e7dd6-bc90-4ec0-af80-361b3a8f3c44 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:33.724334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ad7e7dd6-bc90-4ec0-af80-361b3a8f3c44 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:33.724763 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ad7e7dd6-bc90-4ec0-af80-361b3a8f3c44 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:33.754022 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ad7e7dd6-bc90-4ec0-af80-361b3a8f3c44 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045386 Sep 26 05:36:33.754696 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 443/912] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:36:33 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:36:33.819450 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-afbb44ff-4b2b-4d67-8013-09022b6c8ccd tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:33.819978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-afbb44ff-4b2b-4d67-8013-09022b6c8ccd tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:33.826301 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-afbb44ff-4b2b-4d67-8013-09022b6c8ccd tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:33.826831 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-afbb44ff-4b2b-4d67-8013-09022b6c8ccd tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:33.827312 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-afbb44ff-4b2b-4d67-8013-09022b6c8ccd tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:33.828023 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-afbb44ff-4b2b-4d67-8013-09022b6c8ccd tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:33.828514 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-afbb44ff-4b2b-4d67-8013-09022b6c8ccd tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:33.828946 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-afbb44ff-4b2b-4d67-8013-09022b6c8ccd tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:33.858439 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-afbb44ff-4b2b-4d67-8013-09022b6c8ccd tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Going to try to terminate instance {{(pid=120806) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:36:33.861362 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:33.954899 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-afbb44ff-4b2b-4d67-8013-09022b6c8ccd tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "DELETE /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 204 len: 0 microversion: 2.1 time: 0.138497 Sep 26 05:36:33.955705 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 470/913] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:36:33 2022] DELETE /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:36:33.963860 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-78286909-a49e-4875-9cdd-f9694838b407 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:33.964504 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-78286909-a49e-4875-9cdd-f9694838b407 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:33.971451 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-78286909-a49e-4875-9cdd-f9694838b407 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:33.971944 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-78286909-a49e-4875-9cdd-f9694838b407 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:33.972420 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-78286909-a49e-4875-9cdd-f9694838b407 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:33.973120 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-78286909-a49e-4875-9cdd-f9694838b407 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:33.973581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-78286909-a49e-4875-9cdd-f9694838b407 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:33.974287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-78286909-a49e-4875-9cdd-f9694838b407 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:34.107236 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-78286909-a49e-4875-9cdd-f9694838b407 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:34.115339 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-78286909-a49e-4875-9cdd-f9694838b407 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 200 len: 1683 microversion: 2.1 time: 0.155349 Sep 26 05:36:34.115904 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 444/914] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:33 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:35.139216 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c931ef4e-c919-42ad-9646-02ff13363307 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:35.140004 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c931ef4e-c919-42ad-9646-02ff13363307 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:35.146386 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c931ef4e-c919-42ad-9646-02ff13363307 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:35.147042 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c931ef4e-c919-42ad-9646-02ff13363307 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:35.147530 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c931ef4e-c919-42ad-9646-02ff13363307 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:35.148308 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c931ef4e-c919-42ad-9646-02ff13363307 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:35.148939 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c931ef4e-c919-42ad-9646-02ff13363307 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:35.149367 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c931ef4e-c919-42ad-9646-02ff13363307 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:35.276932 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-c931ef4e-c919-42ad-9646-02ff13363307 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:35.285433 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c931ef4e-c919-42ad-9646-02ff13363307 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 200 len: 1683 microversion: 2.1 time: 0.150585 Sep 26 05:36:35.285993 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 471/915] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:35 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:36.309423 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ff1558d5-8cca-450c-a9ac-a54ae1158a1a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:36.310037 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ff1558d5-8cca-450c-a9ac-a54ae1158a1a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:36.317310 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ff1558d5-8cca-450c-a9ac-a54ae1158a1a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:36.318038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ff1558d5-8cca-450c-a9ac-a54ae1158a1a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:36.318510 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ff1558d5-8cca-450c-a9ac-a54ae1158a1a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:36.319212 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ff1558d5-8cca-450c-a9ac-a54ae1158a1a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:36.319666 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ff1558d5-8cca-450c-a9ac-a54ae1158a1a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:36.320092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ff1558d5-8cca-450c-a9ac-a54ae1158a1a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:36.400841 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ff1558d5-8cca-450c-a9ac-a54ae1158a1a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e588ff6d5a4a37b902abadfb6d04fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd13dd8ec810435491e3f3cba7cca4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:36.409252 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ff1558d5-8cca-450c-a9ac-a54ae1158a1a tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 200 len: 1615 microversion: 2.1 time: 0.103678 Sep 26 05:36:36.409828 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 445/916] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:36 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 1615 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:36.667081 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-78ea0c80-9ec6-4f3a-ba03-93c41863ee5a req-9a6ac999-4316-4543-b812-4aa4cc6a3c2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd42d52-e8d1-447f-882e-7151c7010c2d", "name": "network-vif-deleted", "tag": "a50f5065-0980-4bdd-bcd4-888e4c8e6890"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:36.678678 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-78ea0c80-9ec6-4f3a-ba03-93c41863ee5a req-9a6ac999-4316-4543-b812-4aa4cc6a3c2d service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:36.679166 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-78ea0c80-9ec6-4f3a-ba03-93c41863ee5a req-9a6ac999-4316-4543-b812-4aa4cc6a3c2d service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:36.679608 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-78ea0c80-9ec6-4f3a-ba03-93c41863ee5a req-9a6ac999-4316-4543-b812-4aa4cc6a3c2d service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:36.692329 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-78ea0c80-9ec6-4f3a-ba03-93c41863ee5a req-9a6ac999-4316-4543-b812-4aa4cc6a3c2d service nova] Creating event network-vif-deleted:a50f5065-0980-4bdd-bcd4-888e4c8e6890 for instance acd42d52-e8d1-447f-882e-7151c7010c2d on hv-cinder-85918 Sep 26 05:36:36.697769 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-78ea0c80-9ec6-4f3a-ba03-93c41863ee5a req-9a6ac999-4316-4543-b812-4aa4cc6a3c2d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034437 Sep 26 05:36:36.701417 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 472/917] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:36:37.434220 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1de1167d-ad36-4d8d-a8a3-b83c23f16346 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:37.435606 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1de1167d-ad36-4d8d-a8a3-b83c23f16346 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:37.443692 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1de1167d-ad36-4d8d-a8a3-b83c23f16346 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:37.444185 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1de1167d-ad36-4d8d-a8a3-b83c23f16346 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:37.444690 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1de1167d-ad36-4d8d-a8a3-b83c23f16346 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:37.445738 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1de1167d-ad36-4d8d-a8a3-b83c23f16346 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:37.446208 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1de1167d-ad36-4d8d-a8a3-b83c23f16346 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:37.446692 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1de1167d-ad36-4d8d-a8a3-b83c23f16346 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:37.463093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-1de1167d-ad36-4d8d-a8a3-b83c23f16346 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] HTTP exception thrown: Instance acd42d52-e8d1-447f-882e-7151c7010c2d could not be found. Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1de1167d-ad36-4d8d-a8a3-b83c23f16346 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Request method failure captured: Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d HTTP/1.1 Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTi0HNidMJ_uUjz9W9nG4CLXam9AEEcBUxHuJymFks4FVk8X_UREH6vt6sYWIBIpMYwbfop3-Tu9G5rH-U470tWXr7O7oFa6DqY-WLodQcPeOqi33ywVkGIxoXJu-o6j8RNWX3xYPNIu8TNqBir3Si8HbJUdBskNzCM6QioApbM8lh8 Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:36:37.464827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:36:37.466253 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd13dd8ec810435491e3f3cba7cca4d1"}]}] Sep 26 05:36:37.466253 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:37.466253 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:36:37.466253 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:37.466253 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:36:37.466253 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:36:37.466253 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:36:37.466253 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 48e588ff6d5a4a37b902abadfb6d04fc Sep 26 05:36:37.466253 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:36:37.466253 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:36:37.466253 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance acd42d52-e8d1-447f-882e-7151c7010c2d could not be found. Sep 26 05:36:37.466253 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': 'acd42d52-e8d1-447f-882e-7151c7010c2d'} Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd42d52-e8d1-447f-882e-7151c7010c2d could not be found. Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:36:37.467038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:36:37.468932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:36:37.468932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:36:37.468932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:36:37.468932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:36:37.468932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:36:37.468932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:36:37.468932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:36:37.468932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd42d52-e8d1-447f-882e-7151c7010c2d could not be found. Sep 26 05:36:37.468932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:37.468932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:37.468932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:37.468932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:37.468932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:37.468932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:37.468932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:36:37.468932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:36:37.468932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd42d52-e8d1-447f-882e-7151c7010c2d could not be found. Sep 26 05:36:37.468932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:37.471780 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1de1167d-ad36-4d8d-a8a3-b83c23f16346 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Returning 404 to user: Instance acd42d52-e8d1-447f-882e-7151c7010c2d could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:36:37.471780 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1de1167d-ad36-4d8d-a8a3-b83c23f16346 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 404 len: 111 microversion: 2.1 time: 0.035904 Sep 26 05:36:37.471780 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 446/918] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:37 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:36:37.477560 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-2649e743-6784-4a20-8ff3-5592f4dd6a6e tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '.version_select at 0x7fd7babfac10>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:37.499979 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2649e743-6784-4a20-8ff3-5592f4dd6a6e tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-418654430" status: 202 len: 0 microversion: 2.1 time: 0.026734 Sep 26 05:36:37.501096 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 473/919] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Sep 26 05:36:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-418654430 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:36:39.300757 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3fe3bd6b-a258-4fd0-bdcb-7758959cdaf6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:39.301254 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3fe3bd6b-a258-4fd0-bdcb-7758959cdaf6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:39.307804 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3fe3bd6b-a258-4fd0-bdcb-7758959cdaf6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:39.308438 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3fe3bd6b-a258-4fd0-bdcb-7758959cdaf6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:39.308883 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3fe3bd6b-a258-4fd0-bdcb-7758959cdaf6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:39.309581 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3fe3bd6b-a258-4fd0-bdcb-7758959cdaf6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:39.310041 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3fe3bd6b-a258-4fd0-bdcb-7758959cdaf6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:39.310472 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3fe3bd6b-a258-4fd0-bdcb-7758959cdaf6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:39.325304 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-3fe3bd6b-a258-4fd0-bdcb-7758959cdaf6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] HTTP exception thrown: Instance acd42d52-e8d1-447f-882e-7151c7010c2d could not be found. Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3fe3bd6b-a258-4fd0-bdcb-7758959cdaf6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Request method failure captured: Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: DELETE /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d HTTP/1.1 Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTi0HNidMJ_uUjz9W9nG4CLXam9AEEcBUxHuJymFks4FVk8X_UREH6vt6sYWIBIpMYwbfop3-Tu9G5rH-U470tWXr7O7oFa6DqY-WLodQcPeOqi33ywVkGIxoXJu-o6j8RNWX3xYPNIu8TNqBir3Si8HbJUdBskNzCM6QioApbM8lh8 Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:36:39.326857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:36:39.328538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd13dd8ec810435491e3f3cba7cca4d1"}]}] Sep 26 05:36:39.328538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:39.328538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:36:39.328538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:39.328538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:36:39.328538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:36:39.328538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:36:39.328538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 48e588ff6d5a4a37b902abadfb6d04fc Sep 26 05:36:39.328538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:36:39.328538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:36:39.328538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance acd42d52-e8d1-447f-882e-7151c7010c2d could not be found. Sep 26 05:36:39.328538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': 'acd42d52-e8d1-447f-882e-7151c7010c2d'} Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd42d52-e8d1-447f-882e-7151c7010c2d could not be found. Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:36:39.329870 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd42d52-e8d1-447f-882e-7151c7010c2d could not be found. Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd42d52-e8d1-447f-882e-7151c7010c2d could not be found. Sep 26 05:36:39.331318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:39.333216 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3fe3bd6b-a258-4fd0-bdcb-7758959cdaf6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Returning 404 to user: Instance acd42d52-e8d1-447f-882e-7151c7010c2d could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:36:39.333216 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3fe3bd6b-a258-4fd0-bdcb-7758959cdaf6 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "DELETE /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 404 len: 111 microversion: 2.1 time: 0.031969 Sep 26 05:36:39.333216 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 447/920] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:36:39 2022] DELETE /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:36:39.337125 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-78d54862-2e28-43e6-adf7-ec9ac1f811af tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:39.338119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-78d54862-2e28-43e6-adf7-ec9ac1f811af tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: acd42d52-e8d1-447f-882e-7151c7010c2d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:39.340617 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:39.348048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-78d54862-2e28-43e6-adf7-ec9ac1f811af tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:39.348502 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-78d54862-2e28-43e6-adf7-ec9ac1f811af tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:39.349195 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-78d54862-2e28-43e6-adf7-ec9ac1f811af tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:39.349915 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-78d54862-2e28-43e6-adf7-ec9ac1f811af tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:39.350343 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-78d54862-2e28-43e6-adf7-ec9ac1f811af tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:39.350769 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-78d54862-2e28-43e6-adf7-ec9ac1f811af tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:39.365801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-78d54862-2e28-43e6-adf7-ec9ac1f811af tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] HTTP exception thrown: Instance acd42d52-e8d1-447f-882e-7151c7010c2d could not be found. Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-78d54862-2e28-43e6-adf7-ec9ac1f811af tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Request method failure captured: Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d HTTP/1.1 Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTi0HNidMJ_uUjz9W9nG4CLXam9AEEcBUxHuJymFks4FVk8X_UREH6vt6sYWIBIpMYwbfop3-Tu9G5rH-U470tWXr7O7oFa6DqY-WLodQcPeOqi33ywVkGIxoXJu-o6j8RNWX3xYPNIu8TNqBir3Si8HbJUdBskNzCM6QioApbM8lh8 Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:36:39.367446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:36:39.369034 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd13dd8ec810435491e3f3cba7cca4d1"}]}] Sep 26 05:36:39.369034 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:39.369034 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:36:39.369034 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:39.369034 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:36:39.369034 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:36:39.369034 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:36:39.369034 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 48e588ff6d5a4a37b902abadfb6d04fc Sep 26 05:36:39.369034 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:36:39.369034 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:36:39.369034 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance acd42d52-e8d1-447f-882e-7151c7010c2d could not be found. Sep 26 05:36:39.369034 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': 'acd42d52-e8d1-447f-882e-7151c7010c2d'} Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd42d52-e8d1-447f-882e-7151c7010c2d could not be found. Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:36:39.370171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:36:39.371639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:36:39.371639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:36:39.371639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:36:39.371639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:36:39.371639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:36:39.371639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:36:39.371639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:36:39.371639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd42d52-e8d1-447f-882e-7151c7010c2d could not be found. Sep 26 05:36:39.371639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:39.371639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:39.371639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:39.371639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:39.371639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:39.371639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:39.371639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:36:39.371639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:36:39.371639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd42d52-e8d1-447f-882e-7151c7010c2d could not be found. Sep 26 05:36:39.371639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:39.373113 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-78d54862-2e28-43e6-adf7-ec9ac1f811af tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Returning 404 to user: Instance acd42d52-e8d1-447f-882e-7151c7010c2d could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:36:39.373113 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-78d54862-2e28-43e6-adf7-ec9ac1f811af tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d" status: 404 len: 111 microversion: 2.1 time: 0.035685 Sep 26 05:36:39.373113 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 474/921] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:39 2022] GET /compute/v2.1/servers/acd42d52-e8d1-447f-882e-7151c7010c2d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:36:40.511103 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ca417ee0-335b-475c-8426-6e68d3c1c9f9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:40.511605 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ca417ee0-335b-475c-8426-6e68d3c1c9f9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:40.514030 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=50 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:40.519862 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ca417ee0-335b-475c-8426-6e68d3c1c9f9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:40.520372 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ca417ee0-335b-475c-8426-6e68d3c1c9f9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:40.520804 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ca417ee0-335b-475c-8426-6e68d3c1c9f9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:40.521487 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ca417ee0-335b-475c-8426-6e68d3c1c9f9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:40.521932 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ca417ee0-335b-475c-8426-6e68d3c1c9f9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:40.522348 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ca417ee0-335b-475c-8426-6e68d3c1c9f9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:40.536526 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-ca417ee0-335b-475c-8426-6e68d3c1c9f9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] HTTP exception thrown: Instance 43405413-d653-4c48-acc8-3af217fb7ea2 could not be found. Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ca417ee0-335b-475c-8426-6e68d3c1c9f9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Request method failure captured: Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: DELETE /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 HTTP/1.1 Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTi0HNidMJ_uUjz9W9nG4CLXam9AEEcBUxHuJymFks4FVk8X_UREH6vt6sYWIBIpMYwbfop3-Tu9G5rH-U470tWXr7O7oFa6DqY-WLodQcPeOqi33ywVkGIxoXJu-o6j8RNWX3xYPNIu8TNqBir3Si8HbJUdBskNzCM6QioApbM8lh8 Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:36:40.538092 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:36:40.539683 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd13dd8ec810435491e3f3cba7cca4d1"}]}] Sep 26 05:36:40.539683 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:40.539683 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:36:40.539683 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:40.539683 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:36:40.539683 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:36:40.539683 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:36:40.539683 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 48e588ff6d5a4a37b902abadfb6d04fc Sep 26 05:36:40.539683 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:36:40.539683 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:36:40.539683 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance 43405413-d653-4c48-acc8-3af217fb7ea2 could not be found. Sep 26 05:36:40.539683 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': '43405413-d653-4c48-acc8-3af217fb7ea2'} Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43405413-d653-4c48-acc8-3af217fb7ea2 could not be found. Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:36:40.540649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43405413-d653-4c48-acc8-3af217fb7ea2 could not be found. Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43405413-d653-4c48-acc8-3af217fb7ea2 could not be found. Sep 26 05:36:40.542166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.543774 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ca417ee0-335b-475c-8426-6e68d3c1c9f9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Returning 404 to user: Instance 43405413-d653-4c48-acc8-3af217fb7ea2 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:36:40.543774 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ca417ee0-335b-475c-8426-6e68d3c1c9f9 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "DELETE /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 404 len: 111 microversion: 2.1 time: 0.032150 Sep 26 05:36:40.543774 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 448/922] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:36:40 2022] DELETE /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:36:40.548374 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d934ed13-4aba-47aa-9641-c74de339fc5b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:40.548993 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d934ed13-4aba-47aa-9641-c74de339fc5b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 43405413-d653-4c48-acc8-3af217fb7ea2] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:40.556029 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d934ed13-4aba-47aa-9641-c74de339fc5b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:40.556530 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d934ed13-4aba-47aa-9641-c74de339fc5b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:40.556962 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d934ed13-4aba-47aa-9641-c74de339fc5b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:40.557643 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d934ed13-4aba-47aa-9641-c74de339fc5b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:40.558097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d934ed13-4aba-47aa-9641-c74de339fc5b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:40.558521 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d934ed13-4aba-47aa-9641-c74de339fc5b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:40.573256 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-d934ed13-4aba-47aa-9641-c74de339fc5b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] HTTP exception thrown: Instance 43405413-d653-4c48-acc8-3af217fb7ea2 could not be found. Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d934ed13-4aba-47aa-9641-c74de339fc5b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Request method failure captured: Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 HTTP/1.1 Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTi0HNidMJ_uUjz9W9nG4CLXam9AEEcBUxHuJymFks4FVk8X_UREH6vt6sYWIBIpMYwbfop3-Tu9G5rH-U470tWXr7O7oFa6DqY-WLodQcPeOqi33ywVkGIxoXJu-o6j8RNWX3xYPNIu8TNqBir3Si8HbJUdBskNzCM6QioApbM8lh8 Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:36:40.574805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:36:40.576431 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd13dd8ec810435491e3f3cba7cca4d1"}]}] Sep 26 05:36:40.576431 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:40.576431 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:36:40.576431 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:40.576431 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:36:40.576431 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:36:40.576431 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:36:40.576431 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 48e588ff6d5a4a37b902abadfb6d04fc Sep 26 05:36:40.576431 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:36:40.576431 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:36:40.576431 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance 43405413-d653-4c48-acc8-3af217fb7ea2 could not be found. Sep 26 05:36:40.576431 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': '43405413-d653-4c48-acc8-3af217fb7ea2'} Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43405413-d653-4c48-acc8-3af217fb7ea2 could not be found. Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:36:40.577233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:36:40.578445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:36:40.578445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:36:40.578445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:36:40.578445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:36:40.578445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:36:40.578445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:36:40.578445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:36:40.578445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43405413-d653-4c48-acc8-3af217fb7ea2 could not be found. Sep 26 05:36:40.578445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.578445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:40.578445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.578445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:40.578445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:40.578445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:40.578445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:36:40.578445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:36:40.578445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43405413-d653-4c48-acc8-3af217fb7ea2 could not be found. Sep 26 05:36:40.578445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.580149 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d934ed13-4aba-47aa-9641-c74de339fc5b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Returning 404 to user: Instance 43405413-d653-4c48-acc8-3af217fb7ea2 could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:36:40.580149 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d934ed13-4aba-47aa-9641-c74de339fc5b tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2" status: 404 len: 111 microversion: 2.1 time: 0.032016 Sep 26 05:36:40.580149 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 475/923] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:40 2022] GET /compute/v2.1/servers/43405413-d653-4c48-acc8-3af217fb7ea2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:36:40.585897 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-92824dd2-c0f4-4f08-9431-0a215203c311 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:40.586537 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-92824dd2-c0f4-4f08-9431-0a215203c311 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:40.592749 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-92824dd2-c0f4-4f08-9431-0a215203c311 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:40.593237 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-92824dd2-c0f4-4f08-9431-0a215203c311 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:40.593680 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-92824dd2-c0f4-4f08-9431-0a215203c311 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:40.594432 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-92824dd2-c0f4-4f08-9431-0a215203c311 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:40.594886 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-92824dd2-c0f4-4f08-9431-0a215203c311 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:40.595312 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-92824dd2-c0f4-4f08-9431-0a215203c311 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:40.608824 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-92824dd2-c0f4-4f08-9431-0a215203c311 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] HTTP exception thrown: Instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db could not be found. Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-92824dd2-c0f4-4f08-9431-0a215203c311 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Request method failure captured: Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: DELETE /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db HTTP/1.1 Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTi0HNidMJ_uUjz9W9nG4CLXam9AEEcBUxHuJymFks4FVk8X_UREH6vt6sYWIBIpMYwbfop3-Tu9G5rH-U470tWXr7O7oFa6DqY-WLodQcPeOqi33ywVkGIxoXJu-o6j8RNWX3xYPNIu8TNqBir3Si8HbJUdBskNzCM6QioApbM8lh8 Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:36:40.610585 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:36:40.612146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd13dd8ec810435491e3f3cba7cca4d1"}]}] Sep 26 05:36:40.612146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:40.612146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:36:40.612146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:40.612146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:36:40.612146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:36:40.612146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:36:40.612146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 48e588ff6d5a4a37b902abadfb6d04fc Sep 26 05:36:40.612146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:36:40.612146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:36:40.612146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db could not be found. Sep 26 05:36:40.612146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': '197dc2cf-12cf-4bf8-8dbd-c05654f127db'} Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db could not be found. Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:36:40.612950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db could not be found. Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db could not be found. Sep 26 05:36:40.615388 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.616904 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-92824dd2-c0f4-4f08-9431-0a215203c311 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Returning 404 to user: Instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:36:40.616904 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-92824dd2-c0f4-4f08-9431-0a215203c311 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "DELETE /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 404 len: 111 microversion: 2.1 time: 0.030277 Sep 26 05:36:40.616904 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 449/924] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:36:40 2022] DELETE /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:36:40.621426 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-605590b9-9f91-415f-ad88-141439bafb26 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:40.622044 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-605590b9-9f91-415f-ad88-141439bafb26 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 197dc2cf-12cf-4bf8-8dbd-c05654f127db] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:40.629088 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-605590b9-9f91-415f-ad88-141439bafb26 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:40.629566 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-605590b9-9f91-415f-ad88-141439bafb26 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:40.629998 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-605590b9-9f91-415f-ad88-141439bafb26 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:40.630684 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-605590b9-9f91-415f-ad88-141439bafb26 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:40.631132 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-605590b9-9f91-415f-ad88-141439bafb26 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:40.631549 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-605590b9-9f91-415f-ad88-141439bafb26 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:40.645721 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-605590b9-9f91-415f-ad88-141439bafb26 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] HTTP exception thrown: Instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db could not be found. Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-605590b9-9f91-415f-ad88-141439bafb26 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Request method failure captured: Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db HTTP/1.1 Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTi0HNidMJ_uUjz9W9nG4CLXam9AEEcBUxHuJymFks4FVk8X_UREH6vt6sYWIBIpMYwbfop3-Tu9G5rH-U470tWXr7O7oFa6DqY-WLodQcPeOqi33ywVkGIxoXJu-o6j8RNWX3xYPNIu8TNqBir3Si8HbJUdBskNzCM6QioApbM8lh8 Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:36:40.650119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:36:40.651830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd13dd8ec810435491e3f3cba7cca4d1"}]}] Sep 26 05:36:40.651830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:40.651830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:36:40.651830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:40.651830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:36:40.651830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:36:40.651830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:36:40.651830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 48e588ff6d5a4a37b902abadfb6d04fc Sep 26 05:36:40.651830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:36:40.651830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:36:40.651830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db could not be found. Sep 26 05:36:40.651830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': '197dc2cf-12cf-4bf8-8dbd-c05654f127db'} Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db could not be found. Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:36:40.652763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:36:40.654119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:36:40.654119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:36:40.654119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:36:40.654119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:36:40.654119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:36:40.654119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:36:40.654119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:36:40.654119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db could not be found. Sep 26 05:36:40.654119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.654119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:40.654119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.654119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:40.654119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:40.654119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:40.654119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:36:40.654119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:36:40.654119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db could not be found. Sep 26 05:36:40.654119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:40.655210 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-605590b9-9f91-415f-ad88-141439bafb26 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Returning 404 to user: Instance 197dc2cf-12cf-4bf8-8dbd-c05654f127db could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:36:40.655210 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-605590b9-9f91-415f-ad88-141439bafb26 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db" status: 404 len: 111 microversion: 2.1 time: 0.031864 Sep 26 05:36:40.655210 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 476/925] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:40 2022] GET /compute/v2.1/servers/197dc2cf-12cf-4bf8-8dbd-c05654f127db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:36:41.789325 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8ca8a378-d245-4243-9522-c621655b1a91 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:41.789986 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8ca8a378-d245-4243-9522-c621655b1a91 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:41.796602 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8ca8a378-d245-4243-9522-c621655b1a91 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:41.797089 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8ca8a378-d245-4243-9522-c621655b1a91 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:41.797583 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8ca8a378-d245-4243-9522-c621655b1a91 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:41.798675 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8ca8a378-d245-4243-9522-c621655b1a91 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:41.799216 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8ca8a378-d245-4243-9522-c621655b1a91 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:41.799644 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8ca8a378-d245-4243-9522-c621655b1a91 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:41.812873 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-8ca8a378-d245-4243-9522-c621655b1a91 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] HTTP exception thrown: Instance 149e1a24-0c3f-4697-8982-771b7bbb4215 could not be found. Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8ca8a378-d245-4243-9522-c621655b1a91 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Request method failure captured: Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: DELETE /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 HTTP/1.1 Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTi0HNidMJ_uUjz9W9nG4CLXam9AEEcBUxHuJymFks4FVk8X_UREH6vt6sYWIBIpMYwbfop3-Tu9G5rH-U470tWXr7O7oFa6DqY-WLodQcPeOqi33ywVkGIxoXJu-o6j8RNWX3xYPNIu8TNqBir3Si8HbJUdBskNzCM6QioApbM8lh8 Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:36:41.814653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:36:41.816233 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd13dd8ec810435491e3f3cba7cca4d1"}]}] Sep 26 05:36:41.816233 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:41.816233 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:36:41.816233 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:41.816233 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:36:41.816233 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:36:41.816233 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:36:41.816233 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 48e588ff6d5a4a37b902abadfb6d04fc Sep 26 05:36:41.816233 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:36:41.816233 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:36:41.816233 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance 149e1a24-0c3f-4697-8982-771b7bbb4215 could not be found. Sep 26 05:36:41.816233 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': '149e1a24-0c3f-4697-8982-771b7bbb4215'} Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149e1a24-0c3f-4697-8982-771b7bbb4215 could not be found. Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:36:41.817203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149e1a24-0c3f-4697-8982-771b7bbb4215 could not be found. Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149e1a24-0c3f-4697-8982-771b7bbb4215 could not be found. Sep 26 05:36:41.818706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:41.820139 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8ca8a378-d245-4243-9522-c621655b1a91 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Returning 404 to user: Instance 149e1a24-0c3f-4697-8982-771b7bbb4215 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:36:41.820139 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8ca8a378-d245-4243-9522-c621655b1a91 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "DELETE /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 404 len: 111 microversion: 2.1 time: 0.030685 Sep 26 05:36:41.820139 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 450/926] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:36:41 2022] DELETE /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:36:41.824566 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e19d7c0d-6553-49f0-8f9b-251e95aa26e1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:41.825186 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e19d7c0d-6553-49f0-8f9b-251e95aa26e1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] [instance: 149e1a24-0c3f-4697-8982-771b7bbb4215] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:41.832531 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e19d7c0d-6553-49f0-8f9b-251e95aa26e1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:41.833017 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e19d7c0d-6553-49f0-8f9b-251e95aa26e1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:41.833455 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e19d7c0d-6553-49f0-8f9b-251e95aa26e1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:41.834139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e19d7c0d-6553-49f0-8f9b-251e95aa26e1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:41.834594 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e19d7c0d-6553-49f0-8f9b-251e95aa26e1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:41.835018 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e19d7c0d-6553-49f0-8f9b-251e95aa26e1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:41.849345 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-e19d7c0d-6553-49f0-8f9b-251e95aa26e1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] HTTP exception thrown: Instance 149e1a24-0c3f-4697-8982-771b7bbb4215 could not be found. Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e19d7c0d-6553-49f0-8f9b-251e95aa26e1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Request method failure captured: Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 HTTP/1.1 Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTi0HNidMJ_uUjz9W9nG4CLXam9AEEcBUxHuJymFks4FVk8X_UREH6vt6sYWIBIpMYwbfop3-Tu9G5rH-U470tWXr7O7oFa6DqY-WLodQcPeOqi33ywVkGIxoXJu-o6j8RNWX3xYPNIu8TNqBir3Si8HbJUdBskNzCM6QioApbM8lh8 Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:36:41.850857 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:36:41.852425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd13dd8ec810435491e3f3cba7cca4d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd13dd8ec810435491e3f3cba7cca4d1"}]}] Sep 26 05:36:41.852425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:41.852425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: fd13dd8ec810435491e3f3cba7cca4d1 Sep 26 05:36:41.852425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-546988886 Sep 26 05:36:41.852425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:36:41.852425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:36:41.852425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:36:41.852425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 48e588ff6d5a4a37b902abadfb6d04fc Sep 26 05:36:41.852425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-AttachVolumeNegativeTest-546988886-project Sep 26 05:36:41.852425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:36:41.852425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance 149e1a24-0c3f-4697-8982-771b7bbb4215 could not be found. Sep 26 05:36:41.852425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': '149e1a24-0c3f-4697-8982-771b7bbb4215'} Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149e1a24-0c3f-4697-8982-771b7bbb4215 could not be found. Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:36:41.853249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:36:41.854460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:36:41.854460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:36:41.854460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:36:41.854460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:36:41.854460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:36:41.854460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:36:41.854460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:36:41.854460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149e1a24-0c3f-4697-8982-771b7bbb4215 could not be found. Sep 26 05:36:41.854460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:41.854460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:41.854460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:41.854460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:41.854460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:41.854460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:41.854460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:36:41.854460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:36:41.854460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149e1a24-0c3f-4697-8982-771b7bbb4215 could not be found. Sep 26 05:36:41.854460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:41.855574 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e19d7c0d-6553-49f0-8f9b-251e95aa26e1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] Returning 404 to user: Instance 149e1a24-0c3f-4697-8982-771b7bbb4215 could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:36:41.855574 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e19d7c0d-6553-49f0-8f9b-251e95aa26e1 tempest-AttachVolumeNegativeTest-546988886 tempest-AttachVolumeNegativeTest-546988886-project] 10.222.0.49 "GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215" status: 404 len: 111 microversion: 2.1 time: 0.031467 Sep 26 05:36:41.855574 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 477/927] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:41 2022] GET /compute/v2.1/servers/149e1a24-0c3f-4697-8982-771b7bbb4215 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:36:46.393697 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a7f77cd7-2a6c-4e60-ba56-e4cc0ea27a89 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] Action: 'create', calling method: .version_select at 0x7fd7b7275040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-983682618", "metadata": {"Type": "work"}}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a7f77cd7-2a6c-4e60-ba56-e4cc0ea27a89 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] Request method failure captured: Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 121 Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTpucXDsb7fxGHvN7CUVQeLnaZ-D5xaZ3oTxNKOmZ9gsaHbOIllO1SuPqWXaHlconnIivDurQUjJexMUAK4PLviPAuJvoyz3ezdlEyW78tBC8dSNV11ONrnBGEOVYSNodNLjA5LSDGMuRDpLOofiA9qyiSMJf79v3MfoMu7F-nxvmfI Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: 16145413c8814759ae5d24a90c4179ae Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-VolumesNegativeTest-227736715 Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:36:46.408768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:36:46.410344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/16145413c8814759ae5d24a90c4179ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/16145413c8814759ae5d24a90c4179ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/16145413c8814759ae5d24a90c4179ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_16145413c8814759ae5d24a90c4179ae"}]}] Sep 26 05:36:46.410344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-VolumesNegativeTest-227736715 Sep 26 05:36:46.410344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 16145413c8814759ae5d24a90c4179ae Sep 26 05:36:46.410344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-VolumesNegativeTest-227736715 Sep 26 05:36:46.410344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-VolumesNegativeTest-227736715-project Sep 26 05:36:46.410344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:36:46.410344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:36:46.410344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 5467a4844f3f49a18f0a52f76146072b Sep 26 05:36:46.410344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-VolumesNegativeTest-227736715-project Sep 26 05:36:46.410344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Sep 26 05:36:46.410344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-983682618", "metadata": {"Type": "work"}}} Sep 26 05:36:46.410344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: Sep 26 05:36:46.410344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-983682618', 'metadata': {'Type': 'work'}}}} Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise error Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi '#$%' Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:36:46.411213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 26 05:36:46.412657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 26 05:36:46.413858 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 26 05:36:46.413858 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.413858 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a7f77cd7-2a6c-4e60-ba56-e4cc0ea27a89 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:36:46.413858 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a7f77cd7-2a6c-4e60-ba56-e4cc0ea27a89 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.136507 Sep 26 05:36:46.413858 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 451/928] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Sep 26 05:36:46 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 05:36:46.419895 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-82786db0-6edc-469b-8f46-2cf799e21953 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] Action: 'create', calling method: .version_select at 0x7fd7b732f310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1528099696", "metadata": {"Type": "work"}}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-82786db0-6edc-469b-8f46-2cf799e21953 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] Request method failure captured: Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 120 Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTpucXDsb7fxGHvN7CUVQeLnaZ-D5xaZ3oTxNKOmZ9gsaHbOIllO1SuPqWXaHlconnIivDurQUjJexMUAK4PLviPAuJvoyz3ezdlEyW78tBC8dSNV11ONrnBGEOVYSNodNLjA5LSDGMuRDpLOofiA9qyiSMJf79v3MfoMu7F-nxvmfI Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: 16145413c8814759ae5d24a90c4179ae Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-VolumesNegativeTest-227736715 Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:36:46.424879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:36:46.426478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/16145413c8814759ae5d24a90c4179ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/16145413c8814759ae5d24a90c4179ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/16145413c8814759ae5d24a90c4179ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_16145413c8814759ae5d24a90c4179ae"}]}] Sep 26 05:36:46.426478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-VolumesNegativeTest-227736715 Sep 26 05:36:46.426478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: 16145413c8814759ae5d24a90c4179ae Sep 26 05:36:46.426478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-VolumesNegativeTest-227736715 Sep 26 05:36:46.426478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-VolumesNegativeTest-227736715-project Sep 26 05:36:46.426478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:36:46.426478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:36:46.426478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 5467a4844f3f49a18f0a52f76146072b Sep 26 05:36:46.426478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-VolumesNegativeTest-227736715-project Sep 26 05:36:46.426478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Sep 26 05:36:46.426478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1528099696", "metadata": {"Type": "work"}}} Sep 26 05:36:46.426478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: Sep 26 05:36:46.426478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1528099696', 'metadata': {'Type': 'work'}}}} Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise error Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi '0' Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:36:46.427460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 26 05:36:46.429213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 26 05:36:46.430822 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 26 05:36:46.430822 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.430822 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-82786db0-6edc-469b-8f46-2cf799e21953 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:36:46.430822 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-82786db0-6edc-469b-8f46-2cf799e21953 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010184 Sep 26 05:36:46.430822 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 478/929] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Sep 26 05:36:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 26 05:36:46.435263 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1f4aeda9-9c90-4eac-86b1-bd05d6dbdf55 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] Action: 'create', calling method: .version_select at 0x7fd7b72b41f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1609360364", "metadata": {"Type": "work"}}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1f4aeda9-9c90-4eac-86b1-bd05d6dbdf55 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] Request method failure captured: Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 119 Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTpucXDsb7fxGHvN7CUVQeLnaZ-D5xaZ3oTxNKOmZ9gsaHbOIllO1SuPqWXaHlconnIivDurQUjJexMUAK4PLviPAuJvoyz3ezdlEyW78tBC8dSNV11ONrnBGEOVYSNodNLjA5LSDGMuRDpLOofiA9qyiSMJf79v3MfoMu7F-nxvmfI Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: 16145413c8814759ae5d24a90c4179ae Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-VolumesNegativeTest-227736715 Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:36:46.440627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:36:46.442394 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/16145413c8814759ae5d24a90c4179ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/16145413c8814759ae5d24a90c4179ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/16145413c8814759ae5d24a90c4179ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_16145413c8814759ae5d24a90c4179ae"}]}] Sep 26 05:36:46.442394 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-VolumesNegativeTest-227736715 Sep 26 05:36:46.442394 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 16145413c8814759ae5d24a90c4179ae Sep 26 05:36:46.442394 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-VolumesNegativeTest-227736715 Sep 26 05:36:46.442394 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-VolumesNegativeTest-227736715-project Sep 26 05:36:46.442394 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:36:46.442394 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:36:46.442394 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 5467a4844f3f49a18f0a52f76146072b Sep 26 05:36:46.442394 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-VolumesNegativeTest-227736715-project Sep 26 05:36:46.442394 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Sep 26 05:36:46.442394 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1609360364", "metadata": {"Type": "work"}}} Sep 26 05:36:46.442394 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: Sep 26 05:36:46.442394 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1609360364', 'metadata': {'Type': 'work'}}}} Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise error Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi '' Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:36:46.443361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 26 05:36:46.444848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 26 05:36:46.446298 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 26 05:36:46.446298 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.446298 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1f4aeda9-9c90-4eac-86b1-bd05d6dbdf55 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:36:46.446298 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1f4aeda9-9c90-4eac-86b1-bd05d6dbdf55 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010462 Sep 26 05:36:46.446298 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 452/930] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Sep 26 05:36:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 26 05:36:46.454357 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9a6a1980-7ed7-4a69-bc55-416bc5843c51 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] Calling method '.version_select at 0x7fd7b721b4c0>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:46.482906 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-9a6a1980-7ed7-4a69-bc55-416bc5843c51 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] HTTP exception thrown: Volume tempest-invalid-423526211 could not be found. Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9a6a1980-7ed7-4a69-bc55-416bc5843c51 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] Request method failure captured: Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-423526211 HTTP/1.1 Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTpucXDsb7fxGHvN7CUVQeLnaZ-D5xaZ3oTxNKOmZ9gsaHbOIllO1SuPqWXaHlconnIivDurQUjJexMUAK4PLviPAuJvoyz3ezdlEyW78tBC8dSNV11ONrnBGEOVYSNodNLjA5LSDGMuRDpLOofiA9qyiSMJf79v3MfoMu7F-nxvmfI Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: 16145413c8814759ae5d24a90c4179ae Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-VolumesNegativeTest-227736715 Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:36:46.485058 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:36:46.486761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/16145413c8814759ae5d24a90c4179ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/16145413c8814759ae5d24a90c4179ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/16145413c8814759ae5d24a90c4179ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_16145413c8814759ae5d24a90c4179ae"}]}] Sep 26 05:36:46.486761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-VolumesNegativeTest-227736715 Sep 26 05:36:46.486761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: 16145413c8814759ae5d24a90c4179ae Sep 26 05:36:46.486761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-VolumesNegativeTest-227736715 Sep 26 05:36:46.486761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-VolumesNegativeTest-227736715-project Sep 26 05:36:46.486761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:36:46.486761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:36:46.486761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 5467a4844f3f49a18f0a52f76146072b Sep 26 05:36:46.486761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-VolumesNegativeTest-227736715-project Sep 26 05:36:46.486761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: Sep 26 05:36:46.486761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Volume tempest-invalid-423526211 could not be found. Sep 26 05:36:46.486761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': 'tempest-invalid-423526211'} Sep 26 05:36:46.486761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-423526211 could not be found. (HTTP 404) (Request-ID: req-bb4fb178-58b7-4b8d-9777-45f34abb4a8c) Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:46.487860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 05:36:46.489284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-423526211 could not be found. Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:36:46.490830 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-423526211 could not be found. Sep 26 05:36:46.492413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.492413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:46.492413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.492413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.492413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:46.492413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:46.492413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:36:46.492413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:36:46.492413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-423526211 could not be found. Sep 26 05:36:46.492413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.492413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9a6a1980-7ed7-4a69-bc55-416bc5843c51 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] Returning 404 to user: Volume tempest-invalid-423526211 could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:36:46.492413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-9a6a1980-7ed7-4a69-bc55-416bc5843c51 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-423526211" status: 404 len: 98 microversion: 2.1 time: 0.038184 Sep 26 05:36:46.492413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 479/931] 10.222.0.49 () {58 vars in 1215 bytes} [Mon Sep 26 05:36:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-423526211 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 26 05:36:46.496060 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fe64bcfd-0ed1-479a-98d8-f5f4dfd04a45 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003832 Sep 26 05:36:46.496588 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 453/932] 10.222.0.49 () {58 vars in 1140 bytes} [Mon Sep 26 05:36:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 26 05:36:46.505000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-84d79d12-3aa1-4d47-a7a0-67f893b6389d tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003657 Sep 26 05:36:46.505492 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 480/933] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Sep 26 05:36:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 26 05:36:46.513478 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-28c65dd9-e498-420a-a859-92f3eae8220b tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] Calling method '.version_select at 0x7fd7b72cdaf0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:46.541944 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-28c65dd9-e498-420a-a859-92f3eae8220b tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] HTTP exception thrown: Volume 2b78aab4-8504-4807-bab4-6b951ffad82a could not be found. Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-28c65dd9-e498-420a-a859-92f3eae8220b tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] Request method failure captured: Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: DELETE /compute/v2.1/os-volumes/2b78aab4-8504-4807-bab4-6b951ffad82a HTTP/1.1 Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTpucXDsb7fxGHvN7CUVQeLnaZ-D5xaZ3oTxNKOmZ9gsaHbOIllO1SuPqWXaHlconnIivDurQUjJexMUAK4PLviPAuJvoyz3ezdlEyW78tBC8dSNV11ONrnBGEOVYSNodNLjA5LSDGMuRDpLOofiA9qyiSMJf79v3MfoMu7F-nxvmfI Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: 16145413c8814759ae5d24a90c4179ae Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-VolumesNegativeTest-227736715 Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:36:46.543929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:36:46.545534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/16145413c8814759ae5d24a90c4179ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/16145413c8814759ae5d24a90c4179ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/16145413c8814759ae5d24a90c4179ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_16145413c8814759ae5d24a90c4179ae"}]}] Sep 26 05:36:46.545534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-VolumesNegativeTest-227736715 Sep 26 05:36:46.545534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 16145413c8814759ae5d24a90c4179ae Sep 26 05:36:46.545534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-VolumesNegativeTest-227736715 Sep 26 05:36:46.545534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-VolumesNegativeTest-227736715-project Sep 26 05:36:46.545534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:36:46.545534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:36:46.545534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 5467a4844f3f49a18f0a52f76146072b Sep 26 05:36:46.545534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-VolumesNegativeTest-227736715-project Sep 26 05:36:46.545534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: Sep 26 05:36:46.545534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Volume 2b78aab4-8504-4807-bab4-6b951ffad82a could not be found. Sep 26 05:36:46.545534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': '2b78aab4-8504-4807-bab4-6b951ffad82a'} Sep 26 05:36:46.545534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b78aab4-8504-4807-bab4-6b951ffad82a could not be found. (HTTP 404) (Request-ID: req-e40e88ec-f455-4332-8320-71a09bb567e2) Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:46.546786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 05:36:46.548309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b78aab4-8504-4807-bab4-6b951ffad82a could not be found. Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 26 05:36:46.549735 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:36:46.551213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b78aab4-8504-4807-bab4-6b951ffad82a could not be found. Sep 26 05:36:46.551213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.551213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:46.551213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.551213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.551213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:46.551213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:46.551213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:36:46.551213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:36:46.551213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b78aab4-8504-4807-bab4-6b951ffad82a could not be found. Sep 26 05:36:46.551213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.551213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-28c65dd9-e498-420a-a859-92f3eae8220b tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] Returning 404 to user: Volume 2b78aab4-8504-4807-bab4-6b951ffad82a could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:36:46.551213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-28c65dd9-e498-420a-a859-92f3eae8220b tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/2b78aab4-8504-4807-bab4-6b951ffad82a" status: 404 len: 109 microversion: 2.1 time: 0.035486 Sep 26 05:36:46.551213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 454/934] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 05:36:46 2022] DELETE /compute/v2.1/os-volumes/2b78aab4-8504-4807-bab4-6b951ffad82a => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:36:46.554987 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-012b2a1f-e4b0-4863-a79a-e683ab67d907 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] Calling method '.version_select at 0x7fd7babcfaf0>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:46.583570 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-012b2a1f-e4b0-4863-a79a-e683ab67d907 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] HTTP exception thrown: Volume 2a6bd10e-783f-4231-8bf1-e98a018bcf67 could not be found. Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-012b2a1f-e4b0-4863-a79a-e683ab67d907 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] Request method failure captured: Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/os-volumes/2a6bd10e-783f-4231-8bf1-e98a018bcf67 HTTP/1.1 Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTpucXDsb7fxGHvN7CUVQeLnaZ-D5xaZ3oTxNKOmZ9gsaHbOIllO1SuPqWXaHlconnIivDurQUjJexMUAK4PLviPAuJvoyz3ezdlEyW78tBC8dSNV11ONrnBGEOVYSNodNLjA5LSDGMuRDpLOofiA9qyiSMJf79v3MfoMu7F-nxvmfI Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: 16145413c8814759ae5d24a90c4179ae Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-VolumesNegativeTest-227736715 Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:36:46.586000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:36:46.587596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/16145413c8814759ae5d24a90c4179ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/16145413c8814759ae5d24a90c4179ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/16145413c8814759ae5d24a90c4179ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_16145413c8814759ae5d24a90c4179ae"}]}] Sep 26 05:36:46.587596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-VolumesNegativeTest-227736715 Sep 26 05:36:46.587596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: 16145413c8814759ae5d24a90c4179ae Sep 26 05:36:46.587596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-VolumesNegativeTest-227736715 Sep 26 05:36:46.587596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-VolumesNegativeTest-227736715-project Sep 26 05:36:46.587596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:36:46.587596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:36:46.587596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 5467a4844f3f49a18f0a52f76146072b Sep 26 05:36:46.587596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-VolumesNegativeTest-227736715-project Sep 26 05:36:46.587596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: Sep 26 05:36:46.587596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Volume 2a6bd10e-783f-4231-8bf1-e98a018bcf67 could not be found. Sep 26 05:36:46.587596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': '2a6bd10e-783f-4231-8bf1-e98a018bcf67'} Sep 26 05:36:46.587596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a6bd10e-783f-4231-8bf1-e98a018bcf67 could not be found. (HTTP 404) (Request-ID: req-f3875b95-1ea3-427a-9815-ad4cda6985ce) Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:46.591978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:36:46.593298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a6bd10e-783f-4231-8bf1-e98a018bcf67 could not be found. Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 05:36:46.594607 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:36:46.595758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a6bd10e-783f-4231-8bf1-e98a018bcf67 could not be found. Sep 26 05:36:46.595758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.595758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:36:46.595758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.595758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:36:46.595758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:36:46.595758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:36:46.595758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:36:46.595758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:36:46.595758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a6bd10e-783f-4231-8bf1-e98a018bcf67 could not be found. Sep 26 05:36:46.595758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:36:46.595758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-012b2a1f-e4b0-4863-a79a-e683ab67d907 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] Returning 404 to user: Volume 2a6bd10e-783f-4231-8bf1-e98a018bcf67 could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:36:46.595758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-012b2a1f-e4b0-4863-a79a-e683ab67d907 tempest-VolumesNegativeTest-227736715 tempest-VolumesNegativeTest-227736715-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2a6bd10e-783f-4231-8bf1-e98a018bcf67" status: 404 len: 109 microversion: 2.1 time: 0.036411 Sep 26 05:36:46.595758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 481/935] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 05:36:46 2022] GET /compute/v2.1/os-volumes/2a6bd10e-783f-4231-8bf1-e98a018bcf67 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:36:55.983013 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=5 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:55.985049 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=55 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:55.990938 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-245fcc4e-eff8-441d-9529-41cf6768cc81 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:55.991470 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-245fcc4e-eff8-441d-9529-41cf6768cc81 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:55.998303 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-245fcc4e-eff8-441d-9529-41cf6768cc81 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:55.998999 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-245fcc4e-eff8-441d-9529-41cf6768cc81 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:56.000459 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-245fcc4e-eff8-441d-9529-41cf6768cc81 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:56.001734 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-245fcc4e-eff8-441d-9529-41cf6768cc81 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:56.002247 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-245fcc4e-eff8-441d-9529-41cf6768cc81 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:56.002682 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-245fcc4e-eff8-441d-9529-41cf6768cc81 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:56.006010 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-6665cfac-690c-4d7f-8a26-9221b5b94709 req-9d9f6969-4d64-4058-b439-17b2421295e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b60837af-4528-4e98-bb46-0e80e3270c0d", "tag": "7672989d-ca9b-46a1-b56a-6c9d7ec17b2d"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:56.014008 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=7 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:56.017167 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:56.031082 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-6665cfac-690c-4d7f-8a26-9221b5b94709 req-9d9f6969-4d64-4058-b439-17b2421295e4 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:56.033506 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-245fcc4e-eff8-441d-9529-41cf6768cc81 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Going to try to terminate instance {{(pid=120805) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:36:56.034110 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-6665cfac-690c-4d7f-8a26-9221b5b94709 req-9d9f6969-4d64-4058-b439-17b2421295e4 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:56.034889 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-6665cfac-690c-4d7f-8a26-9221b5b94709 req-9d9f6969-4d64-4058-b439-17b2421295e4 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:56.054146 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-6665cfac-690c-4d7f-8a26-9221b5b94709 req-9d9f6969-4d64-4058-b439-17b2421295e4 service nova] Creating event network-changed:7672989d-ca9b-46a1-b56a-6c9d7ec17b2d for instance b60837af-4528-4e98-bb46-0e80e3270c0d on hv-cinder-85918 Sep 26 05:36:56.061350 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-6665cfac-690c-4d7f-8a26-9221b5b94709 req-9d9f6969-4d64-4058-b439-17b2421295e4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063695 Sep 26 05:36:56.066520 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 482/936] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:36:56.161705 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-245fcc4e-eff8-441d-9529-41cf6768cc81 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 204 len: 0 microversion: 2.1 time: 0.179330 Sep 26 05:36:56.164812 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 455/937] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:36:55 2022] DELETE /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:36:56.174404 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-92751b93-476a-442b-8f6c-40bb438e3bca tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:56.175193 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-92751b93-476a-442b-8f6c-40bb438e3bca tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:56.186840 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92751b93-476a-442b-8f6c-40bb438e3bca tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:56.194060 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92751b93-476a-442b-8f6c-40bb438e3bca tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:56.194680 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92751b93-476a-442b-8f6c-40bb438e3bca tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:56.195551 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92751b93-476a-442b-8f6c-40bb438e3bca tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:56.196154 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92751b93-476a-442b-8f6c-40bb438e3bca tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:56.196764 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92751b93-476a-442b-8f6c-40bb438e3bca tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:56.388860 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-92751b93-476a-442b-8f6c-40bb438e3bca tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:56.398059 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-92751b93-476a-442b-8f6c-40bb438e3bca tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.230044 Sep 26 05:36:56.398992 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 483/938] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:56 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:57.423494 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ddf343b3-80c7-47b4-aabd-04bd1bd13261 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:57.424202 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ddf343b3-80c7-47b4-aabd-04bd1bd13261 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:57.430955 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ddf343b3-80c7-47b4-aabd-04bd1bd13261 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:57.431442 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ddf343b3-80c7-47b4-aabd-04bd1bd13261 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:57.431875 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ddf343b3-80c7-47b4-aabd-04bd1bd13261 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:57.432592 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ddf343b3-80c7-47b4-aabd-04bd1bd13261 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:57.433067 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ddf343b3-80c7-47b4-aabd-04bd1bd13261 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:57.433485 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ddf343b3-80c7-47b4-aabd-04bd1bd13261 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:57.585573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ddf343b3-80c7-47b4-aabd-04bd1bd13261 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:57.594467 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ddf343b3-80c7-47b4-aabd-04bd1bd13261 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1570 microversion: 2.1 time: 0.175297 Sep 26 05:36:57.604798 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 456/939] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:57 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:58.620394 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5366211e-8e5d-4c97-9949-8747091e7f9c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:58.621024 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5366211e-8e5d-4c97-9949-8747091e7f9c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:58.628482 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5366211e-8e5d-4c97-9949-8747091e7f9c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:58.628896 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5366211e-8e5d-4c97-9949-8747091e7f9c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:58.629511 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5366211e-8e5d-4c97-9949-8747091e7f9c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:58.630237 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5366211e-8e5d-4c97-9949-8747091e7f9c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:58.630682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5366211e-8e5d-4c97-9949-8747091e7f9c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:58.631108 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5366211e-8e5d-4c97-9949-8747091e7f9c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:58.774916 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5366211e-8e5d-4c97-9949-8747091e7f9c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:58.784223 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5366211e-8e5d-4c97-9949-8747091e7f9c tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1451 microversion: 2.1 time: 0.167506 Sep 26 05:36:58.801320 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 484/940] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:58 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1451 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:58.861203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-3b969664-93b3-49a9-8cf4-05ac248968df req-5cc83d4a-b185-408c-ae13-59f928874834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b60837af-4528-4e98-bb46-0e80e3270c0d", "name": "network-vif-deleted", "tag": "7672989d-ca9b-46a1-b56a-6c9d7ec17b2d"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:58.871753 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-3b969664-93b3-49a9-8cf4-05ac248968df req-5cc83d4a-b185-408c-ae13-59f928874834 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:58.871753 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-3b969664-93b3-49a9-8cf4-05ac248968df req-5cc83d4a-b185-408c-ae13-59f928874834 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:58.872980 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-3b969664-93b3-49a9-8cf4-05ac248968df req-5cc83d4a-b185-408c-ae13-59f928874834 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:58.885816 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-3b969664-93b3-49a9-8cf4-05ac248968df req-5cc83d4a-b185-408c-ae13-59f928874834 service nova] Creating event network-vif-deleted:7672989d-ca9b-46a1-b56a-6c9d7ec17b2d for instance b60837af-4528-4e98-bb46-0e80e3270c0d on hv-cinder-85918 Sep 26 05:36:58.891105 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-3b969664-93b3-49a9-8cf4-05ac248968df req-5cc83d4a-b185-408c-ae13-59f928874834 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034812 Sep 26 05:36:58.891874 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 457/941] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:36:59.809854 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b8803504-1208-4d14-9f36-bc2f60e3d1f7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:59.810849 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b8803504-1208-4d14-9f36-bc2f60e3d1f7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:36:59.817288 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b8803504-1208-4d14-9f36-bc2f60e3d1f7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:59.817817 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b8803504-1208-4d14-9f36-bc2f60e3d1f7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:59.818269 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b8803504-1208-4d14-9f36-bc2f60e3d1f7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:59.818964 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b8803504-1208-4d14-9f36-bc2f60e3d1f7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:59.819412 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b8803504-1208-4d14-9f36-bc2f60e3d1f7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:59.819829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b8803504-1208-4d14-9f36-bc2f60e3d1f7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:59.852119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b8803504-1208-4d14-9f36-bc2f60e3d1f7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:36:59.852635 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b8803504-1208-4d14-9f36-bc2f60e3d1f7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:36:59.853074 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b8803504-1208-4d14-9f36-bc2f60e3d1f7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:36:59.853563 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-b8803504-1208-4d14-9f36-bc2f60e3d1f7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lazy-loading 'fault' on Instance uuid b60837af-4528-4e98-bb46-0e80e3270c0d {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:36:59.899184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b8803504-1208-4d14-9f36-bc2f60e3d1f7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0794e19f43a413db886750b0517d3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5f9daf8d44a6987bbff8939ed7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:36:59.907447 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b8803504-1208-4d14-9f36-bc2f60e3d1f7 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 200 len: 1179 microversion: 2.1 time: 0.101468 Sep 26 05:36:59.908138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 485/942] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:36:59 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 1179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:00.932090 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5da00b29-0df0-4f9c-8382-a4a29be4408f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:00.932909 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5da00b29-0df0-4f9c-8382-a4a29be4408f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] [instance: b60837af-4528-4e98-bb46-0e80e3270c0d] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:00.939971 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5da00b29-0df0-4f9c-8382-a4a29be4408f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:00.940489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5da00b29-0df0-4f9c-8382-a4a29be4408f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:00.940925 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5da00b29-0df0-4f9c-8382-a4a29be4408f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:00.942309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5da00b29-0df0-4f9c-8382-a4a29be4408f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:00.942910 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5da00b29-0df0-4f9c-8382-a4a29be4408f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:00.943394 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5da00b29-0df0-4f9c-8382-a4a29be4408f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:00.959519 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-5da00b29-0df0-4f9c-8382-a4a29be4408f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] HTTP exception thrown: Instance b60837af-4528-4e98-bb46-0e80e3270c0d could not be found. Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5da00b29-0df0-4f9c-8382-a4a29be4408f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Request method failure captured: Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d HTTP/1.1 Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTj22pb8IiUD8Ya2WAIZWAy48c3xXllpee06rchhCpvVlMlNn9IaB8ZKvbtZQyoaKk7_5_4Law71xNpj9Xf1uNmOKI8A3G865zlVOVEfQKMlroLd8hU5Di0S1RogX2P8sNioSz_R1RRwL6evVtJ75lzJNpXc0819wF6l06En-UpAy8g Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: e1b5f9daf8d44a6987bbff8939ed7c92 Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-TestShelveInstance-1352166379 Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:37:00.961287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:37:00.962953 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e1b5f9daf8d44a6987bbff8939ed7c92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e1b5f9daf8d44a6987bbff8939ed7c92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e1b5f9daf8d44a6987bbff8939ed7c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e1b5f9daf8d44a6987bbff8939ed7c92"}]}] Sep 26 05:37:00.962953 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-TestShelveInstance-1352166379 Sep 26 05:37:00.962953 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: e1b5f9daf8d44a6987bbff8939ed7c92 Sep 26 05:37:00.962953 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-TestShelveInstance-1352166379 Sep 26 05:37:00.962953 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-TestShelveInstance-1352166379-project Sep 26 05:37:00.962953 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:37:00.962953 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:37:00.962953 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: a0794e19f43a413db886750b0517d3d3 Sep 26 05:37:00.962953 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-TestShelveInstance-1352166379-project Sep 26 05:37:00.962953 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:37:00.962953 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance b60837af-4528-4e98-bb46-0e80e3270c0d could not be found. Sep 26 05:37:00.962953 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': 'b60837af-4528-4e98-bb46-0e80e3270c0d'} Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b60837af-4528-4e98-bb46-0e80e3270c0d could not be found. Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:37:00.963956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:37:00.965398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:00.965398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:37:00.965398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:37:00.965398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:37:00.965398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:37:00.965398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:37:00.965398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:37:00.965398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b60837af-4528-4e98-bb46-0e80e3270c0d could not be found. Sep 26 05:37:00.965398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:37:00.965398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:00.965398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:37:00.965398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:00.965398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:00.965398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:00.965398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:37:00.965398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:37:00.965398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b60837af-4528-4e98-bb46-0e80e3270c0d could not be found. Sep 26 05:37:00.965398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:37:00.966717 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5da00b29-0df0-4f9c-8382-a4a29be4408f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Returning 404 to user: Instance b60837af-4528-4e98-bb46-0e80e3270c0d could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:37:00.966717 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5da00b29-0df0-4f9c-8382-a4a29be4408f tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d" status: 404 len: 111 microversion: 2.1 time: 0.035184 Sep 26 05:37:00.966717 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 458/943] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:00 2022] GET /compute/v2.1/servers/b60837af-4528-4e98-bb46-0e80e3270c0d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:37:01.138479 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d140661f-8ad9-408f-a5ec-06c2c6607ef6 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] Calling method '.version_select at 0x7fd7babcef70>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:01.165132 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d140661f-8ad9-408f-a5ec-06c2c6607ef6 tempest-TestShelveInstance-1352166379 tempest-TestShelveInstance-1352166379-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1112145332" status: 202 len: 0 microversion: 2.1 time: 0.030370 Sep 26 05:37:01.165710 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 486/944] 10.222.0.49 () {58 vars in 1254 bytes} [Mon Sep 26 05:37:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1112145332 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:37:11.792866 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3b19ea05-f703-4501-a8dd-eeff91a33507 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:11.796645 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3b19ea05-f703-4501-a8dd-eeff91a33507 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:11.800310 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:11.806710 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:11.819858 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b19ea05-f703-4501-a8dd-eeff91a33507 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:11.820641 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b19ea05-f703-4501-a8dd-eeff91a33507 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:11.821540 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b19ea05-f703-4501-a8dd-eeff91a33507 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:11.822529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b19ea05-f703-4501-a8dd-eeff91a33507 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:11.823023 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b19ea05-f703-4501-a8dd-eeff91a33507 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:11.824675 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b19ea05-f703-4501-a8dd-eeff91a33507 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:11.871084 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3b19ea05-f703-4501-a8dd-eeff91a33507 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.083097 Sep 26 05:37:11.871835 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 459/945] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Sep 26 05:37:11 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:11.947211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=22 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:11.949012 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:11.957814 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c143ee01-2044-4c4c-b2ff-2639c74689f1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:11.958394 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c143ee01-2044-4c4c-b2ff-2639c74689f1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:11.967031 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c143ee01-2044-4c4c-b2ff-2639c74689f1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:11.968732 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c143ee01-2044-4c4c-b2ff-2639c74689f1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:11.969578 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c143ee01-2044-4c4c-b2ff-2639c74689f1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:11.970506 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c143ee01-2044-4c4c-b2ff-2639c74689f1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:11.971272 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c143ee01-2044-4c4c-b2ff-2639c74689f1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:11.971935 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c143ee01-2044-4c4c-b2ff-2639c74689f1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:12.013413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c143ee01-2044-4c4c-b2ff-2639c74689f1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Going to try to terminate instance {{(pid=120806) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:37:12.263368 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c143ee01-2044-4c4c-b2ff-2639c74689f1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 204 len: 0 microversion: 2.20 time: 0.317494 Sep 26 05:37:12.266425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 487/946] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Sep 26 05:37:11 2022] DELETE /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 05:37:12.276650 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-132deb7c-7154-4030-ae24-49aa1f22def1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:12.277607 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-132deb7c-7154-4030-ae24-49aa1f22def1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:12.284200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-132deb7c-7154-4030-ae24-49aa1f22def1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:12.284722 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-132deb7c-7154-4030-ae24-49aa1f22def1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:12.285162 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-132deb7c-7154-4030-ae24-49aa1f22def1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:12.285868 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-132deb7c-7154-4030-ae24-49aa1f22def1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:12.286316 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-132deb7c-7154-4030-ae24-49aa1f22def1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:12.286743 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-132deb7c-7154-4030-ae24-49aa1f22def1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:12.473513 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-132deb7c-7154-4030-ae24-49aa1f22def1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:12.484046 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-132deb7c-7154-4030-ae24-49aa1f22def1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:12.491054 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-132deb7c-7154-4030-ae24-49aa1f22def1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:12.492696 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-132deb7c-7154-4030-ae24-49aa1f22def1 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.222135 Sep 26 05:37:12.493861 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 460/947] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:37:12 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:37:12.985742 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6a80dbab-2bef-4069-a12a-a3d21088c183 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:12.986337 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6a80dbab-2bef-4069-a12a-a3d21088c183 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:12.994819 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2d7fbe75-228f-4681-830d-ac14d7521c7c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:12.995297 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2d7fbe75-228f-4681-830d-ac14d7521c7c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:13.004108 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d7fbe75-228f-4681-830d-ac14d7521c7c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:13.004630 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d7fbe75-228f-4681-830d-ac14d7521c7c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:13.005071 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d7fbe75-228f-4681-830d-ac14d7521c7c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:13.005779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d7fbe75-228f-4681-830d-ac14d7521c7c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:13.006239 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d7fbe75-228f-4681-830d-ac14d7521c7c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:13.006668 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d7fbe75-228f-4681-830d-ac14d7521c7c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:13.013563 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6a80dbab-2bef-4069-a12a-a3d21088c183 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:13.014901 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6a80dbab-2bef-4069-a12a-a3d21088c183 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:13.015345 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6a80dbab-2bef-4069-a12a-a3d21088c183 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:13.016164 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6a80dbab-2bef-4069-a12a-a3d21088c183 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:13.016656 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6a80dbab-2bef-4069-a12a-a3d21088c183 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:13.017269 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6a80dbab-2bef-4069-a12a-a3d21088c183 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:13.041591 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2d7fbe75-228f-4681-830d-ac14d7521c7c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/ips" status: 200 len: 144 microversion: 2.1 time: 0.050503 Sep 26 05:37:13.049612 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 461/948] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 05:37:12 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/ips => generated 144 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:13.056297 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6a80dbab-2bef-4069-a12a-a3d21088c183 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Going to try to terminate instance {{(pid=120806) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:37:13.197270 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6a80dbab-2bef-4069-a12a-a3d21088c183 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 204 len: 0 microversion: 2.1 time: 0.214714 Sep 26 05:37:13.198214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 488/949] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:37:12 2022] DELETE /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:37:13.208258 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-53e570f3-eac7-4201-810b-d1cb9cfeb08f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:13.209003 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-53e570f3-eac7-4201-810b-d1cb9cfeb08f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:13.217681 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53e570f3-eac7-4201-810b-d1cb9cfeb08f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:13.218272 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53e570f3-eac7-4201-810b-d1cb9cfeb08f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:13.218836 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53e570f3-eac7-4201-810b-d1cb9cfeb08f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:13.219746 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53e570f3-eac7-4201-810b-d1cb9cfeb08f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:13.220360 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53e570f3-eac7-4201-810b-d1cb9cfeb08f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:13.221406 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53e570f3-eac7-4201-810b-d1cb9cfeb08f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:13.486296 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-53e570f3-eac7-4201-810b-d1cb9cfeb08f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:13.498971 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-53e570f3-eac7-4201-810b-d1cb9cfeb08f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1577 microversion: 2.1 time: 0.295137 Sep 26 05:37:13.501446 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 462/950] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:13 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1577 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:13.521800 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f6940ef8-a3dc-4397-a765-0bd0f82b695c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:13.522714 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f6940ef8-a3dc-4397-a765-0bd0f82b695c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:13.530292 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f6940ef8-a3dc-4397-a765-0bd0f82b695c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:13.531327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f6940ef8-a3dc-4397-a765-0bd0f82b695c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:13.531865 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f6940ef8-a3dc-4397-a765-0bd0f82b695c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:13.532611 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f6940ef8-a3dc-4397-a765-0bd0f82b695c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:13.533233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f6940ef8-a3dc-4397-a765-0bd0f82b695c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:13.533671 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f6940ef8-a3dc-4397-a765-0bd0f82b695c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:13.801181 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f6940ef8-a3dc-4397-a765-0bd0f82b695c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:13.817150 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f6940ef8-a3dc-4397-a765-0bd0f82b695c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:13.820777 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f6940ef8-a3dc-4397-a765-0bd0f82b695c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:13.823068 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f6940ef8-a3dc-4397-a765-0bd0f82b695c tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.306728 Sep 26 05:37:13.824420 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 489/951] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:37:13 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:37:14.544466 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cd37375e-cd74-4033-a68c-50e064c33c72 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:14.544466 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cd37375e-cd74-4033-a68c-50e064c33c72 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:14.551104 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cd37375e-cd74-4033-a68c-50e064c33c72 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:14.551609 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cd37375e-cd74-4033-a68c-50e064c33c72 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:14.552201 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cd37375e-cd74-4033-a68c-50e064c33c72 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:14.552976 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cd37375e-cd74-4033-a68c-50e064c33c72 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:14.553378 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-4cfcd087-c53c-4e21-8dfd-d2ece90d80fc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b76e08a8-4d00-4e07-9e55-ba3132bd01d9"}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:14.555079 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cd37375e-cd74-4033-a68c-50e064c33c72 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:14.555727 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cd37375e-cd74-4033-a68c-50e064c33c72 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:14.555855 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-4cfcd087-c53c-4e21-8dfd-d2ece90d80fc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:14.573521 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4cfcd087-c53c-4e21-8dfd-d2ece90d80fc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:14.574020 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4cfcd087-c53c-4e21-8dfd-d2ece90d80fc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:14.578963 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4cfcd087-c53c-4e21-8dfd-d2ece90d80fc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:14.580113 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4cfcd087-c53c-4e21-8dfd-d2ece90d80fc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:14.580765 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4cfcd087-c53c-4e21-8dfd-d2ece90d80fc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:14.581347 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4cfcd087-c53c-4e21-8dfd-d2ece90d80fc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:14.871139 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cd37375e-cd74-4033-a68c-50e064c33c72 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:14.896752 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cd37375e-cd74-4033-a68c-50e064c33c72 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1577 microversion: 2.1 time: 0.360376 Sep 26 05:37:14.897829 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 463/952] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:14 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1577 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:14.906553 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-27ea2c8e-801e-447d-bb36-8e9aa67fd393 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:14.907299 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-27ea2c8e-801e-447d-bb36-8e9aa67fd393 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:14.923734 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-27ea2c8e-801e-447d-bb36-8e9aa67fd393 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:14.924517 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-27ea2c8e-801e-447d-bb36-8e9aa67fd393 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:14.926260 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-27ea2c8e-801e-447d-bb36-8e9aa67fd393 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:14.927156 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-27ea2c8e-801e-447d-bb36-8e9aa67fd393 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:14.927786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-27ea2c8e-801e-447d-bb36-8e9aa67fd393 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:14.928956 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-27ea2c8e-801e-447d-bb36-8e9aa67fd393 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:15.171434 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-4cfcd087-c53c-4e21-8dfd-d2ece90d80fc tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "POST /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.622709 Sep 26 05:37:15.194310 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 490/953] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 05:37:14 2022] POST /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments => generated 194 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:15.524296 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-27ea2c8e-801e-447d-bb36-8e9aa67fd393 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:15.541945 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-27ea2c8e-801e-447d-bb36-8e9aa67fd393 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:15.547454 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-27ea2c8e-801e-447d-bb36-8e9aa67fd393 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f59b47841a4b62b8e368562c7bd210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e1c15ae90e4b82b4e216b3a0549e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:15.549681 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-27ea2c8e-801e-447d-bb36-8e9aa67fd393 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 200 len: 1723 microversion: 2.20 time: 0.650870 Sep 26 05:37:15.551117 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 464/954] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:37:14 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 1723 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:37:15.928779 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-dad16c90-2e4f-4219-bda3-9824980ddfeb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:15.930114 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-dad16c90-2e4f-4219-bda3-9824980ddfeb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:15.944519 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dad16c90-2e4f-4219-bda3-9824980ddfeb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:15.946069 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dad16c90-2e4f-4219-bda3-9824980ddfeb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:15.949398 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dad16c90-2e4f-4219-bda3-9824980ddfeb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:15.950377 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dad16c90-2e4f-4219-bda3-9824980ddfeb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:15.951133 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dad16c90-2e4f-4219-bda3-9824980ddfeb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:15.951765 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-dad16c90-2e4f-4219-bda3-9824980ddfeb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:16.134381 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-c054d110-180d-41a3-82ed-9bcc2bb9bbb5 req-3c276900-80bc-45e8-8345-bf20012abedf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e", "name": "network-vif-deleted", "tag": "d2d361e4-87bf-4197-9996-68e762a01ce3"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:16.163384 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-c054d110-180d-41a3-82ed-9bcc2bb9bbb5 req-3c276900-80bc-45e8-8345-bf20012abedf service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:16.164202 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-c054d110-180d-41a3-82ed-9bcc2bb9bbb5 req-3c276900-80bc-45e8-8345-bf20012abedf service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:16.165325 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-c054d110-180d-41a3-82ed-9bcc2bb9bbb5 req-3c276900-80bc-45e8-8345-bf20012abedf service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:16.180802 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-c054d110-180d-41a3-82ed-9bcc2bb9bbb5 req-3c276900-80bc-45e8-8345-bf20012abedf service nova] Creating event network-vif-deleted:d2d361e4-87bf-4197-9996-68e762a01ce3 for instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e on hv-cinder-85918 Sep 26 05:37:16.187782 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-c054d110-180d-41a3-82ed-9bcc2bb9bbb5 req-3c276900-80bc-45e8-8345-bf20012abedf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063140 Sep 26 05:37:16.193563 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 465/955] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:16.580370 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d175c2fe-b685-492f-bed4-5a632b15bfc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:16.581913 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d175c2fe-b685-492f-bed4-5a632b15bfc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:16.607376 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d175c2fe-b685-492f-bed4-5a632b15bfc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:16.610949 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d175c2fe-b685-492f-bed4-5a632b15bfc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:16.614326 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d175c2fe-b685-492f-bed4-5a632b15bfc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:16.621407 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d175c2fe-b685-492f-bed4-5a632b15bfc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:16.621899 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d175c2fe-b685-492f-bed4-5a632b15bfc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:16.622422 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d175c2fe-b685-492f-bed4-5a632b15bfc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:16.666701 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-d175c2fe-b685-492f-bed4-5a632b15bfc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] HTTP exception thrown: Instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e could not be found. Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d175c2fe-b685-492f-bed4-5a632b15bfc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Request method failure captured: Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e HTTP/1.1 Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTiz2OmkTjdhxQJsvp9AVg2qQXBTZ-PRHUznl8AJKUgptoto2TwSgLS73ZYL-evFaBq0DgJkMkFXRxXWUZWefH6H5ExxHVMWzDk_BuJEwSgqsv-0uVI3SzKbWkJ_JNxWsw-EibM9a4_eC14ss1y5nzjMd5ds-wkso_y588pyQPqJgVk Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: e5e1c15ae90e4b82b4e216b3a0549e2e Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1107555367 Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:37:16.673586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:37:16.675396 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e5e1c15ae90e4b82b4e216b3a0549e2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5e1c15ae90e4b82b4e216b3a0549e2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5e1c15ae90e4b82b4e216b3a0549e2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e5e1c15ae90e4b82b4e216b3a0549e2e"}]}] Sep 26 05:37:16.675396 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1107555367 Sep 26 05:37:16.675396 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: e5e1c15ae90e4b82b4e216b3a0549e2e Sep 26 05:37:16.675396 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1107555367 Sep 26 05:37:16.675396 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeShelveTestJSON-1107555367-project Sep 26 05:37:16.675396 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:37:16.675396 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:37:16.675396 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: a8f59b47841a4b62b8e368562c7bd210 Sep 26 05:37:16.675396 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1107555367-project Sep 26 05:37:16.675396 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:37:16.675396 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e could not be found. Sep 26 05:37:16.675396 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': 'e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e'} Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e could not be found. Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:37:16.676344 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:37:16.677837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:16.677837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:37:16.677837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:37:16.677837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:37:16.677837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:37:16.677837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:37:16.677837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:37:16.677837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e could not be found. Sep 26 05:37:16.677837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:37:16.677837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:16.677837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:37:16.677837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:16.677837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:16.677837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:16.677837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:37:16.677837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:37:16.677837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e could not be found. Sep 26 05:37:16.677837 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:37:16.680325 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d175c2fe-b685-492f-bed4-5a632b15bfc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Returning 404 to user: Instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:37:16.682600 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d175c2fe-b685-492f-bed4-5a632b15bfc5 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 404 len: 111 microversion: 2.20 time: 0.107003 Sep 26 05:37:16.685046 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 466/956] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:37:16 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 26 05:37:16.703700 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3c339bfa-665e-4578-8935-0dad44b67328 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '.version_select at 0x7fd7b760d940>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:16.755707 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3c339bfa-665e-4578-8935-0dad44b67328 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-582591418" status: 204 len: 0 microversion: 2.20 time: 0.060718 Sep 26 05:37:16.757484 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 467/957] 10.222.0.49 () {60 vars in 1259 bytes} [Mon Sep 26 05:37:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-582591418 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 05:37:16.764410 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-dad16c90-2e4f-4219-bda3-9824980ddfeb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:16.781424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-dad16c90-2e4f-4219-bda3-9824980ddfeb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1577 microversion: 2.1 time: 0.855507 Sep 26 05:37:16.801042 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 491/958] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:15 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1577 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:17.815954 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8ea0c787-dc96-4b4d-ae75-5b881b8e5de8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:17.820806 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8ea0c787-dc96-4b4d-ae75-5b881b8e5de8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:17.832493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8ea0c787-dc96-4b4d-ae75-5b881b8e5de8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:17.833303 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8ea0c787-dc96-4b4d-ae75-5b881b8e5de8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:17.834107 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8ea0c787-dc96-4b4d-ae75-5b881b8e5de8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:17.836176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8ea0c787-dc96-4b4d-ae75-5b881b8e5de8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:17.836835 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8ea0c787-dc96-4b4d-ae75-5b881b8e5de8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:17.838123 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8ea0c787-dc96-4b4d-ae75-5b881b8e5de8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:17.961571 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8ea0c787-dc96-4b4d-ae75-5b881b8e5de8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:17.979576 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8ea0c787-dc96-4b4d-ae75-5b881b8e5de8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1509 microversion: 2.1 time: 0.171722 Sep 26 05:37:17.988289 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 468/959] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:17 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:18.123011 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-c8bcebeb-1cc1-443a-a845-7a2874cd9384 req-2f63cca3-02a2-4e73-a753-4561520b15b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d690507f-f032-475f-b4c4-4f5274841bf9", "name": "network-vif-deleted", "tag": "f0547fbd-b0c0-43fb-b376-7a42fb7ce357"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:18.153954 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-c8bcebeb-1cc1-443a-a845-7a2874cd9384 req-2f63cca3-02a2-4e73-a753-4561520b15b1 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:18.155348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-c8bcebeb-1cc1-443a-a845-7a2874cd9384 req-2f63cca3-02a2-4e73-a753-4561520b15b1 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:18.171938 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-c8bcebeb-1cc1-443a-a845-7a2874cd9384 req-2f63cca3-02a2-4e73-a753-4561520b15b1 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:18.241970 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-c8bcebeb-1cc1-443a-a845-7a2874cd9384 req-2f63cca3-02a2-4e73-a753-4561520b15b1 service nova] Creating event network-vif-deleted:f0547fbd-b0c0-43fb-b376-7a42fb7ce357 for instance d690507f-f032-475f-b4c4-4f5274841bf9 on hv-cinder-85918 Sep 26 05:37:18.266378 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-c8bcebeb-1cc1-443a-a845-7a2874cd9384 req-2f63cca3-02a2-4e73-a753-4561520b15b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148239 Sep 26 05:37:18.267254 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 492/960] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:19.010788 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9faef265-0367-400e-b9d6-f86f0e28c0fa tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:19.011578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9faef265-0367-400e-b9d6-f86f0e28c0fa tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:19.021394 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9faef265-0367-400e-b9d6-f86f0e28c0fa tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:19.023605 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9faef265-0367-400e-b9d6-f86f0e28c0fa tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:19.024996 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9faef265-0367-400e-b9d6-f86f0e28c0fa tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:19.026410 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9faef265-0367-400e-b9d6-f86f0e28c0fa tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:19.027463 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9faef265-0367-400e-b9d6-f86f0e28c0fa tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:19.028316 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9faef265-0367-400e-b9d6-f86f0e28c0fa tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:19.110841 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9faef265-0367-400e-b9d6-f86f0e28c0fa tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:19.114120 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9faef265-0367-400e-b9d6-f86f0e28c0fa tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:19.114835 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9faef265-0367-400e-b9d6-f86f0e28c0fa tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:19.115535 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-9faef265-0367-400e-b9d6-f86f0e28c0fa tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lazy-loading 'fault' on Instance uuid d690507f-f032-475f-b4c4-4f5274841bf9 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:37:19.207838 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9faef265-0367-400e-b9d6-f86f0e28c0fa tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:19.220924 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9faef265-0367-400e-b9d6-f86f0e28c0fa tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 200 len: 1230 microversion: 2.1 time: 0.215619 Sep 26 05:37:19.231523 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 469/961] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:19 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 1230 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:19.806589 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c6cca26f-fc20-4837-a7da-50c259b72c7f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:19.807191 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c6cca26f-fc20-4837-a7da-50c259b72c7f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:19.829931 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c6cca26f-fc20-4837-a7da-50c259b72c7f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:19.835121 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c6cca26f-fc20-4837-a7da-50c259b72c7f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:19.836840 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c6cca26f-fc20-4837-a7da-50c259b72c7f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:19.838131 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c6cca26f-fc20-4837-a7da-50c259b72c7f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:19.838827 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c6cca26f-fc20-4837-a7da-50c259b72c7f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:19.839446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c6cca26f-fc20-4837-a7da-50c259b72c7f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:19.887322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-c6cca26f-fc20-4837-a7da-50c259b72c7f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] HTTP exception thrown: Instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e could not be found. Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c6cca26f-fc20-4837-a7da-50c259b72c7f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Request method failure captured: Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: DELETE /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e HTTP/1.1 Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTiz2OmkTjdhxQJsvp9AVg2qQXBTZ-PRHUznl8AJKUgptoto2TwSgLS73ZYL-evFaBq0DgJkMkFXRxXWUZWefH6H5ExxHVMWzDk_BuJEwSgqsv-0uVI3SzKbWkJ_JNxWsw-EibM9a4_eC14ss1y5nzjMd5ds-wkso_y588pyQPqJgVk Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: e5e1c15ae90e4b82b4e216b3a0549e2e Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1107555367 Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:37:19.894910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:37:19.896682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e5e1c15ae90e4b82b4e216b3a0549e2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5e1c15ae90e4b82b4e216b3a0549e2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5e1c15ae90e4b82b4e216b3a0549e2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e5e1c15ae90e4b82b4e216b3a0549e2e"}]}] Sep 26 05:37:19.896682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1107555367 Sep 26 05:37:19.896682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: e5e1c15ae90e4b82b4e216b3a0549e2e Sep 26 05:37:19.896682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1107555367 Sep 26 05:37:19.896682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-AttachVolumeShelveTestJSON-1107555367-project Sep 26 05:37:19.896682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:37:19.896682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:37:19.896682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: a8f59b47841a4b62b8e368562c7bd210 Sep 26 05:37:19.896682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1107555367-project Sep 26 05:37:19.896682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:37:19.896682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e could not be found. Sep 26 05:37:19.896682 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': 'e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e'} Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e could not be found. Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:37:19.897583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e could not be found. Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e could not be found. Sep 26 05:37:19.899078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:19.902295 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c6cca26f-fc20-4837-a7da-50c259b72c7f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Returning 404 to user: Instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:37:19.952302 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c6cca26f-fc20-4837-a7da-50c259b72c7f tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 404 len: 111 microversion: 2.20 time: 0.136851 Sep 26 05:37:19.953340 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 493/962] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Sep 26 05:37:19 2022] DELETE /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 05:37:19.962363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-98014203-ad9c-4014-a98d-c95d19838dab tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:19.963156 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-98014203-ad9c-4014-a98d-c95d19838dab tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:19.985052 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98014203-ad9c-4014-a98d-c95d19838dab tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:19.985554 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98014203-ad9c-4014-a98d-c95d19838dab tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:19.986000 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98014203-ad9c-4014-a98d-c95d19838dab tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:19.986709 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98014203-ad9c-4014-a98d-c95d19838dab tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:19.987166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98014203-ad9c-4014-a98d-c95d19838dab tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:19.991830 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98014203-ad9c-4014-a98d-c95d19838dab tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:20.013999 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-98014203-ad9c-4014-a98d-c95d19838dab tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] HTTP exception thrown: Instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e could not be found. Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-98014203-ad9c-4014-a98d-c95d19838dab tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Request method failure captured: Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e HTTP/1.1 Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTiz2OmkTjdhxQJsvp9AVg2qQXBTZ-PRHUznl8AJKUgptoto2TwSgLS73ZYL-evFaBq0DgJkMkFXRxXWUZWefH6H5ExxHVMWzDk_BuJEwSgqsv-0uVI3SzKbWkJ_JNxWsw-EibM9a4_eC14ss1y5nzjMd5ds-wkso_y588pyQPqJgVk Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: e5e1c15ae90e4b82b4e216b3a0549e2e Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1107555367 Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:37:20.016322 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:37:20.018055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e5e1c15ae90e4b82b4e216b3a0549e2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5e1c15ae90e4b82b4e216b3a0549e2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5e1c15ae90e4b82b4e216b3a0549e2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e5e1c15ae90e4b82b4e216b3a0549e2e"}]}] Sep 26 05:37:20.018055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1107555367 Sep 26 05:37:20.018055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: e5e1c15ae90e4b82b4e216b3a0549e2e Sep 26 05:37:20.018055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1107555367 Sep 26 05:37:20.018055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeShelveTestJSON-1107555367-project Sep 26 05:37:20.018055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:37:20.018055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:37:20.018055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: a8f59b47841a4b62b8e368562c7bd210 Sep 26 05:37:20.018055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1107555367-project Sep 26 05:37:20.018055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:37:20.018055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e could not be found. Sep 26 05:37:20.018055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': 'e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e'} Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e could not be found. Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:37:20.018939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:37:20.020421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:20.020421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:37:20.020421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:37:20.020421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:37:20.020421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:37:20.020421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:37:20.020421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:37:20.020421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e could not be found. Sep 26 05:37:20.020421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:37:20.020421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:20.020421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:37:20.020421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:20.020421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:20.020421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:20.020421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:37:20.020421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:37:20.020421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e could not be found. Sep 26 05:37:20.020421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:37:20.023523 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-98014203-ad9c-4014-a98d-c95d19838dab tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Returning 404 to user: Instance e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:37:20.024906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-98014203-ad9c-4014-a98d-c95d19838dab tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e" status: 404 len: 111 microversion: 2.20 time: 0.067155 Sep 26 05:37:20.025756 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 470/963] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:37:19 2022] GET /compute/v2.1/servers/e47fb6ca-ac5f-4483-b2cf-86ea0c8b642e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 05:37:20.256880 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1fc27014-2671-4bf9-8a4d-3656622c6cbd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:20.261503 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-1fc27014-2671-4bf9-8a4d-3656622c6cbd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:20.281333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1fc27014-2671-4bf9-8a4d-3656622c6cbd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:20.282040 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1fc27014-2671-4bf9-8a4d-3656622c6cbd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:20.283754 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1fc27014-2671-4bf9-8a4d-3656622c6cbd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:20.284776 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1fc27014-2671-4bf9-8a4d-3656622c6cbd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:20.285594 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1fc27014-2671-4bf9-8a4d-3656622c6cbd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:20.286343 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1fc27014-2671-4bf9-8a4d-3656622c6cbd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:20.312881 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-1fc27014-2671-4bf9-8a4d-3656622c6cbd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] HTTP exception thrown: Instance d690507f-f032-475f-b4c4-4f5274841bf9 could not be found. Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1fc27014-2671-4bf9-8a4d-3656622c6cbd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Request method failure captured: Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 HTTP/1.1 Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTnOXhzRVI6npHC9kXb00MocY9EEo6wyShvEH072rcUp5NBGcYDNbn0nRgd45nslLibbJg58_w54gNPux1kdyYdDTf04AugTlN2OdgatBlbYhju0z67J2dnenyukSMD1EVuK-oUKMclPcP68ZhX5y_B14wjkvbdjVxe8wf7xsC_oM7s Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: 774c63ee5fc74c619f63c64590c154e4 Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-TestVolumeBootPattern-597728443 Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:37:20.315067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:37:20.316658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/774c63ee5fc74c619f63c64590c154e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/774c63ee5fc74c619f63c64590c154e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/774c63ee5fc74c619f63c64590c154e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_774c63ee5fc74c619f63c64590c154e4"}]}] Sep 26 05:37:20.316658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-TestVolumeBootPattern-597728443 Sep 26 05:37:20.316658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: 774c63ee5fc74c619f63c64590c154e4 Sep 26 05:37:20.316658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-TestVolumeBootPattern-597728443 Sep 26 05:37:20.316658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-TestVolumeBootPattern-597728443-project Sep 26 05:37:20.316658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:37:20.316658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:37:20.316658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 57daecc890ac421b8eb7b5fb4bf25411 Sep 26 05:37:20.316658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-TestVolumeBootPattern-597728443-project Sep 26 05:37:20.316658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:37:20.316658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance d690507f-f032-475f-b4c4-4f5274841bf9 could not be found. Sep 26 05:37:20.316658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': 'd690507f-f032-475f-b4c4-4f5274841bf9'} Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d690507f-f032-475f-b4c4-4f5274841bf9 could not be found. Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:37:20.317622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:37:20.318960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:20.318960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:37:20.318960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:37:20.318960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:37:20.318960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:37:20.318960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:37:20.318960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:37:20.318960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d690507f-f032-475f-b4c4-4f5274841bf9 could not be found. Sep 26 05:37:20.318960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:20.318960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:20.318960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:20.318960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:20.318960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:20.318960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:20.318960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:37:20.318960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:37:20.318960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d690507f-f032-475f-b4c4-4f5274841bf9 could not be found. Sep 26 05:37:20.318960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:20.325800 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1fc27014-2671-4bf9-8a4d-3656622c6cbd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Returning 404 to user: Instance d690507f-f032-475f-b4c4-4f5274841bf9 could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:37:20.327611 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1fc27014-2671-4bf9-8a4d-3656622c6cbd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 404 len: 111 microversion: 2.1 time: 0.076336 Sep 26 05:37:20.338942 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 494/964] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:20 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:37:20.505350 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1803939192", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-641338499", "security_groups": [{"name": "tempest-secgroup-smoke-1686962999"}], "block_device_mapping_v2": [{"uuid": "c24b125c-1700-4425-80c5-c2bcaf23b807", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa57f4f4-2276-4970-8337-66a125f8a06a"}]}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:20.777213 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] validate_networks() for [('aa57f4f4-2276-4970-8337-66a125f8a06a', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:37:21.243133 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3903cfab-d388-432c-b87f-ff4bbd6d8791 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:21.244037 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-3903cfab-d388-432c-b87f-ff4bbd6d8791 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:21.254458 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3903cfab-d388-432c-b87f-ff4bbd6d8791 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:21.255283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3903cfab-d388-432c-b87f-ff4bbd6d8791 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:21.255969 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3903cfab-d388-432c-b87f-ff4bbd6d8791 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:21.257481 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3903cfab-d388-432c-b87f-ff4bbd6d8791 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:21.258019 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3903cfab-d388-432c-b87f-ff4bbd6d8791 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:21.258666 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3903cfab-d388-432c-b87f-ff4bbd6d8791 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:21.273704 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-3903cfab-d388-432c-b87f-ff4bbd6d8791 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] HTTP exception thrown: Instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 could not be found. Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3903cfab-d388-432c-b87f-ff4bbd6d8791 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Request method failure captured: Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: DELETE /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 HTTP/1.1 Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTiz2OmkTjdhxQJsvp9AVg2qQXBTZ-PRHUznl8AJKUgptoto2TwSgLS73ZYL-evFaBq0DgJkMkFXRxXWUZWefH6H5ExxHVMWzDk_BuJEwSgqsv-0uVI3SzKbWkJ_JNxWsw-EibM9a4_eC14ss1y5nzjMd5ds-wkso_y588pyQPqJgVk Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: e5e1c15ae90e4b82b4e216b3a0549e2e Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1107555367 Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:37:21.276048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:37:21.277558 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e5e1c15ae90e4b82b4e216b3a0549e2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5e1c15ae90e4b82b4e216b3a0549e2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5e1c15ae90e4b82b4e216b3a0549e2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e5e1c15ae90e4b82b4e216b3a0549e2e"}]}] Sep 26 05:37:21.277558 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1107555367 Sep 26 05:37:21.277558 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: e5e1c15ae90e4b82b4e216b3a0549e2e Sep 26 05:37:21.277558 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1107555367 Sep 26 05:37:21.277558 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-AttachVolumeShelveTestJSON-1107555367-project Sep 26 05:37:21.277558 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:37:21.277558 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:37:21.277558 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: a8f59b47841a4b62b8e368562c7bd210 Sep 26 05:37:21.277558 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1107555367-project Sep 26 05:37:21.277558 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:37:21.277558 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 could not be found. Sep 26 05:37:21.277558 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': '6ffa337e-39e1-4edc-9a0d-4468ff05c577'} Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 could not be found. Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:37:21.278348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 could not be found. Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 could not be found. Sep 26 05:37:21.279693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:21.282383 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3903cfab-d388-432c-b87f-ff4bbd6d8791 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Returning 404 to user: Instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:37:21.283439 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-3903cfab-d388-432c-b87f-ff4bbd6d8791 tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 404 len: 111 microversion: 2.20 time: 0.044209 Sep 26 05:37:21.284731 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 495/965] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Sep 26 05:37:21 2022] DELETE /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 05:37:21.292826 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-de6dbffa-9f5b-4cdf-818d-cedf4ce8070a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:21.293608 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:37:21.294065 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:37:21.294326 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-de6dbffa-9f5b-4cdf-818d-cedf4ce8070a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] [instance: 6ffa337e-39e1-4edc-9a0d-4468ff05c577] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:21.294494 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:37:21.295874 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:37:21.296732 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:37:21.301480 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de6dbffa-9f5b-4cdf-818d-cedf4ce8070a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:21.302087 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de6dbffa-9f5b-4cdf-818d-cedf4ce8070a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:21.302532 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de6dbffa-9f5b-4cdf-818d-cedf4ce8070a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:21.303235 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de6dbffa-9f5b-4cdf-818d-cedf4ce8070a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:21.303869 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de6dbffa-9f5b-4cdf-818d-cedf4ce8070a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:21.304161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de6dbffa-9f5b-4cdf-818d-cedf4ce8070a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:21.308367 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:21.309087 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:21.309539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:21.311807 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:21.312304 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:21.312839 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:21.320363 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-de6dbffa-9f5b-4cdf-818d-cedf4ce8070a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] HTTP exception thrown: Instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 could not be found. Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-de6dbffa-9f5b-4cdf-818d-cedf4ce8070a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Request method failure captured: Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 HTTP/1.1 Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTiz2OmkTjdhxQJsvp9AVg2qQXBTZ-PRHUznl8AJKUgptoto2TwSgLS73ZYL-evFaBq0DgJkMkFXRxXWUZWefH6H5ExxHVMWzDk_BuJEwSgqsv-0uVI3SzKbWkJ_JNxWsw-EibM9a4_eC14ss1y5nzjMd5ds-wkso_y588pyQPqJgVk Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: e5e1c15ae90e4b82b4e216b3a0549e2e Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1107555367 Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:37:21.323380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:37:21.325184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e5e1c15ae90e4b82b4e216b3a0549e2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5e1c15ae90e4b82b4e216b3a0549e2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5e1c15ae90e4b82b4e216b3a0549e2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e5e1c15ae90e4b82b4e216b3a0549e2e"}]}] Sep 26 05:37:21.325184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1107555367 Sep 26 05:37:21.325184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: e5e1c15ae90e4b82b4e216b3a0549e2e Sep 26 05:37:21.325184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1107555367 Sep 26 05:37:21.325184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-AttachVolumeShelveTestJSON-1107555367-project Sep 26 05:37:21.325184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:37:21.325184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:37:21.325184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: a8f59b47841a4b62b8e368562c7bd210 Sep 26 05:37:21.325184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1107555367-project Sep 26 05:37:21.325184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:37:21.325184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 could not be found. Sep 26 05:37:21.325184 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': '6ffa337e-39e1-4edc-9a0d-4468ff05c577'} Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 could not be found. Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:37:21.326314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:37:21.327603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:21.327603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:37:21.327603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:37:21.327603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:37:21.327603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:37:21.327603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:37:21.327603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:37:21.327603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 could not be found. Sep 26 05:37:21.327603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:21.327603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:21.327603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:21.327603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:21.327603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:21.327603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:21.327603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:37:21.327603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:37:21.327603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 could not be found. Sep 26 05:37:21.327603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:37:21.329672 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-de6dbffa-9f5b-4cdf-818d-cedf4ce8070a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] Returning 404 to user: Instance 6ffa337e-39e1-4edc-9a0d-4468ff05c577 could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:37:21.332431 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-de6dbffa-9f5b-4cdf-818d-cedf4ce8070a tempest-AttachVolumeShelveTestJSON-1107555367 tempest-AttachVolumeShelveTestJSON-1107555367-project] 10.222.0.49 "GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577" status: 404 len: 111 microversion: 2.20 time: 0.041553 Sep 26 05:37:21.332737 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Getting quotas for project 774c63ee5fc74c619f63c64590c154e4. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:37:21.333864 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 496/966] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 05:37:21 2022] GET /compute/v2.1/servers/6ffa337e-39e1-4edc-9a0d-4468ff05c577 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 26 05:37:21.344746 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Getting quotas for user 57daecc890ac421b8eb7b5fb4bf25411 and project 774c63ee5fc74c619f63c64590c154e4. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:37:21.485817 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:37:21.490508 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c24b125c-1700-4425-80c5-c2bcaf23b807',volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:37:21.781722 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR oslo.messaging._drivers.impl_rabbit [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [2f01965b-684d-486a-8cea-68e7391b69da] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 26 05:37:22.261439 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3e0b16d4-5dae-465c-b370-2ab7418eb36e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:22.267251 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-3e0b16d4-5dae-465c-b370-2ab7418eb36e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:22.281716 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3e0b16d4-5dae-465c-b370-2ab7418eb36e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:22.285401 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3e0b16d4-5dae-465c-b370-2ab7418eb36e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:22.286031 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3e0b16d4-5dae-465c-b370-2ab7418eb36e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:22.286939 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3e0b16d4-5dae-465c-b370-2ab7418eb36e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:22.288212 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3e0b16d4-5dae-465c-b370-2ab7418eb36e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:22.289166 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3e0b16d4-5dae-465c-b370-2ab7418eb36e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:22.354751 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-3e0b16d4-5dae-465c-b370-2ab7418eb36e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104422 Sep 26 05:37:22.356285 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 497/967] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:37:22 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:22.370943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-40c15d1d-1806-4b1d-8cd8-4fe92993ec1b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:22.372355 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-40c15d1d-1806-4b1d-8cd8-4fe92993ec1b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:22.388776 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-40c15d1d-1806-4b1d-8cd8-4fe92993ec1b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:22.390049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-40c15d1d-1806-4b1d-8cd8-4fe92993ec1b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:22.391427 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-40c15d1d-1806-4b1d-8cd8-4fe92993ec1b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:22.393435 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-40c15d1d-1806-4b1d-8cd8-4fe92993ec1b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:22.394095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-40c15d1d-1806-4b1d-8cd8-4fe92993ec1b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:22.394933 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-40c15d1d-1806-4b1d-8cd8-4fe92993ec1b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:22.440063 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-40c15d1d-1806-4b1d-8cd8-4fe92993ec1b tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments/b76e08a8-4d00-4e07-9e55-ba3132bd01d9" status: 200 len: 194 microversion: 2.1 time: 0.076560 Sep 26 05:37:22.440977 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 498/968] 10.222.0.49 () {58 vars in 1413 bytes} [Mon Sep 26 05:37:22 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments/b76e08a8-4d00-4e07-9e55-ba3132bd01d9 => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:22.791506 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO oslo.messaging._drivers.impl_rabbit [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [2f01965b-684d-486a-8cea-68e7391b69da] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44106. Sep 26 05:37:22.803047 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-303e1d16-3012-4b18-b5c8-8fbfe6b1e7bb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.301651 Sep 26 05:37:22.804887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 471/969] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:37:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 2304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:37:22.816548 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-8f7deaf4-2448-4a1e-81b5-cbcaa9613157 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:22.817542 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-8f7deaf4-2448-4a1e-81b5-cbcaa9613157 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:22.919245 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8f7deaf4-2448-4a1e-81b5-cbcaa9613157 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:22.931982 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-8f7deaf4-2448-4a1e-81b5-cbcaa9613157 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1094 microversion: 2.1 time: 0.119260 Sep 26 05:37:22.932756 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 499/970] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:22 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1094 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:23.959222 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-aaec3749-2c74-4695-b884-1bee925b6bd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:23.959848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-aaec3749-2c74-4695-b884-1bee925b6bd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:23.976396 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aaec3749-2c74-4695-b884-1bee925b6bd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:23.976896 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aaec3749-2c74-4695-b884-1bee925b6bd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:23.977327 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aaec3749-2c74-4695-b884-1bee925b6bd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:23.978041 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aaec3749-2c74-4695-b884-1bee925b6bd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:23.978502 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aaec3749-2c74-4695-b884-1bee925b6bd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:23.978923 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aaec3749-2c74-4695-b884-1bee925b6bd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:24.155603 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-aaec3749-2c74-4695-b884-1bee925b6bd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:24.172330 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-aaec3749-2c74-4695-b884-1bee925b6bd4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1192 microversion: 2.1 time: 0.218090 Sep 26 05:37:24.178446 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 472/971] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:23 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1192 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:24.220576 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-88d58b92-b853-4b4f-917a-5400c0ebbc23 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7e3b4e7-0ecc-4a66-a7fd-54c113aaab5e"}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:24.223839 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-88d58b92-b853-4b4f-917a-5400c0ebbc23 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:24.233922 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-88d58b92-b853-4b4f-917a-5400c0ebbc23 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:24.234906 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-88d58b92-b853-4b4f-917a-5400c0ebbc23 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:24.251141 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-88d58b92-b853-4b4f-917a-5400c0ebbc23 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:24.252476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-88d58b92-b853-4b4f-917a-5400c0ebbc23 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:24.253164 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-88d58b92-b853-4b4f-917a-5400c0ebbc23 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:24.253796 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-88d58b92-b853-4b4f-917a-5400c0ebbc23 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:24.867006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-88d58b92-b853-4b4f-917a-5400c0ebbc23 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "POST /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.651240 Sep 26 05:37:24.875347 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 500/972] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 05:37:24 2022] POST /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments => generated 194 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:25.209324 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b7180542-a570-41b8-ab8a-89760ab47258 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:25.210271 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b7180542-a570-41b8-ab8a-89760ab47258 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:25.224537 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7180542-a570-41b8-ab8a-89760ab47258 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:25.226783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7180542-a570-41b8-ab8a-89760ab47258 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:25.228061 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7180542-a570-41b8-ab8a-89760ab47258 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:25.233217 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7180542-a570-41b8-ab8a-89760ab47258 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:25.258039 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7180542-a570-41b8-ab8a-89760ab47258 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:25.259199 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7180542-a570-41b8-ab8a-89760ab47258 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:25.473557 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b7180542-a570-41b8-ab8a-89760ab47258 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:25.484407 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b7180542-a570-41b8-ab8a-89760ab47258 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1210 microversion: 2.1 time: 0.280955 Sep 26 05:37:25.487000 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 473/973] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:25 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1210 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:26.515933 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-96fe4a7a-83eb-4771-bd00-2d4666efeb01 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:26.517281 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-96fe4a7a-83eb-4771-bd00-2d4666efeb01 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:26.532101 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-96fe4a7a-83eb-4771-bd00-2d4666efeb01 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:26.536917 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-96fe4a7a-83eb-4771-bd00-2d4666efeb01 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:26.539071 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-96fe4a7a-83eb-4771-bd00-2d4666efeb01 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:26.550873 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-96fe4a7a-83eb-4771-bd00-2d4666efeb01 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:26.551710 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-96fe4a7a-83eb-4771-bd00-2d4666efeb01 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:26.552355 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-96fe4a7a-83eb-4771-bd00-2d4666efeb01 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:27.364132 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-96fe4a7a-83eb-4771-bd00-2d4666efeb01 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:27.367924 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:27.392760 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-96fe4a7a-83eb-4771-bd00-2d4666efeb01 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.877832 Sep 26 05:37:27.396350 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 501/974] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:26 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:28.425964 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a03f68e5-63e1-4bf9-81c4-4e564db7162c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:28.426592 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a03f68e5-63e1-4bf9-81c4-4e564db7162c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:28.437597 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a03f68e5-63e1-4bf9-81c4-4e564db7162c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:28.438386 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a03f68e5-63e1-4bf9-81c4-4e564db7162c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:28.439158 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a03f68e5-63e1-4bf9-81c4-4e564db7162c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:28.440116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a03f68e5-63e1-4bf9-81c4-4e564db7162c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:28.440819 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a03f68e5-63e1-4bf9-81c4-4e564db7162c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:28.441417 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a03f68e5-63e1-4bf9-81c4-4e564db7162c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:28.804804 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a03f68e5-63e1-4bf9-81c4-4e564db7162c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:28.820415 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a03f68e5-63e1-4bf9-81c4-4e564db7162c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.398020 Sep 26 05:37:28.823374 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 474/975] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:28 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:28.973040 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-a4cbe0a3-d7e3-41e4-a814-c2ccdeab7e73 req-81f97389-7259-464a-8b7d-ba165eb68629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6a2248-68b0-4336-ade5-c6c3b756cdae", "tag": "e47ebac1-d877-4ac1-8e2f-fb371cb2f895"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:28.988119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-a4cbe0a3-d7e3-41e4-a814-c2ccdeab7e73 req-81f97389-7259-464a-8b7d-ba165eb68629 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:28.988890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-a4cbe0a3-d7e3-41e4-a814-c2ccdeab7e73 req-81f97389-7259-464a-8b7d-ba165eb68629 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:28.990883 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-a4cbe0a3-d7e3-41e4-a814-c2ccdeab7e73 req-81f97389-7259-464a-8b7d-ba165eb68629 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:29.014539 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-a4cbe0a3-d7e3-41e4-a814-c2ccdeab7e73 req-81f97389-7259-464a-8b7d-ba165eb68629 service nova] Creating event network-changed:e47ebac1-d877-4ac1-8e2f-fb371cb2f895 for instance 1e6a2248-68b0-4336-ade5-c6c3b756cdae on hv-cinder-85918 Sep 26 05:37:29.022762 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-a4cbe0a3-d7e3-41e4-a814-c2ccdeab7e73 req-81f97389-7259-464a-8b7d-ba165eb68629 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053263 Sep 26 05:37:29.024655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 502/976] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:29.843596 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8a123203-d1a6-4a02-aaed-809fa29eb49b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:29.844218 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8a123203-d1a6-4a02-aaed-809fa29eb49b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:29.851939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8a123203-d1a6-4a02-aaed-809fa29eb49b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:29.852677 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8a123203-d1a6-4a02-aaed-809fa29eb49b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:29.853567 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8a123203-d1a6-4a02-aaed-809fa29eb49b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:29.855087 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8a123203-d1a6-4a02-aaed-809fa29eb49b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:29.856424 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8a123203-d1a6-4a02-aaed-809fa29eb49b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:29.857922 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8a123203-d1a6-4a02-aaed-809fa29eb49b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:30.129879 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8a123203-d1a6-4a02-aaed-809fa29eb49b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:30.137744 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8a123203-d1a6-4a02-aaed-809fa29eb49b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.298170 Sep 26 05:37:30.140392 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 475/977] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:29 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:31.161956 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-8a0a4b26-26cb-4827-859d-7c7821aa5e6b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:31.162792 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-8a0a4b26-26cb-4827-859d-7c7821aa5e6b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:31.178392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8a0a4b26-26cb-4827-859d-7c7821aa5e6b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:31.179721 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8a0a4b26-26cb-4827-859d-7c7821aa5e6b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:31.180752 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8a0a4b26-26cb-4827-859d-7c7821aa5e6b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:31.183721 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8a0a4b26-26cb-4827-859d-7c7821aa5e6b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:31.184496 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8a0a4b26-26cb-4827-859d-7c7821aa5e6b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:31.186897 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8a0a4b26-26cb-4827-859d-7c7821aa5e6b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:31.403162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8a0a4b26-26cb-4827-859d-7c7821aa5e6b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:31.414633 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-8a0a4b26-26cb-4827-859d-7c7821aa5e6b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.257578 Sep 26 05:37:31.416613 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 503/978] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:31 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:32.448620 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d111b63d-3690-49dc-a7be-1b9286158839 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:32.452085 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d111b63d-3690-49dc-a7be-1b9286158839 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:32.475337 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:32.476862 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=6 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:32.483326 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d111b63d-3690-49dc-a7be-1b9286158839 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:32.483847 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d111b63d-3690-49dc-a7be-1b9286158839 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:32.484384 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d111b63d-3690-49dc-a7be-1b9286158839 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:32.485026 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d111b63d-3690-49dc-a7be-1b9286158839 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:32.485487 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d111b63d-3690-49dc-a7be-1b9286158839 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:32.485928 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d111b63d-3690-49dc-a7be-1b9286158839 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:32.744964 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d111b63d-3690-49dc-a7be-1b9286158839 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:32.760883 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d111b63d-3690-49dc-a7be-1b9286158839 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.318969 Sep 26 05:37:32.761876 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 476/979] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:32 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:33.168166 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-711c432b-a0a9-4390-9079-0eec1bb76b43 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:33.172425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-711c432b-a0a9-4390-9079-0eec1bb76b43 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:33.174097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:33.177671 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-711c432b-a0a9-4390-9079-0eec1bb76b43 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:33.178333 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-711c432b-a0a9-4390-9079-0eec1bb76b43 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:33.178976 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-711c432b-a0a9-4390-9079-0eec1bb76b43 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:33.179669 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-711c432b-a0a9-4390-9079-0eec1bb76b43 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:33.180122 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-711c432b-a0a9-4390-9079-0eec1bb76b43 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:33.180582 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-711c432b-a0a9-4390-9079-0eec1bb76b43 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:33.219911 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-711c432b-a0a9-4390-9079-0eec1bb76b43 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055621 Sep 26 05:37:33.220704 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 504/980] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:37:33 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:33.369548 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b6acaebd-f181-4f65-a65f-77ca91da2d88 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:33.370624 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b6acaebd-f181-4f65-a65f-77ca91da2d88 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:33.377210 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6acaebd-f181-4f65-a65f-77ca91da2d88 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:33.377697 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6acaebd-f181-4f65-a65f-77ca91da2d88 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:33.378328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6acaebd-f181-4f65-a65f-77ca91da2d88 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:33.379031 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6acaebd-f181-4f65-a65f-77ca91da2d88 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:33.379490 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6acaebd-f181-4f65-a65f-77ca91da2d88 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:33.380089 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6acaebd-f181-4f65-a65f-77ca91da2d88 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:33.419489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b6acaebd-f181-4f65-a65f-77ca91da2d88 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments/b76e08a8-4d00-4e07-9e55-ba3132bd01d9" status: 200 len: 194 microversion: 2.1 time: 0.054635 Sep 26 05:37:33.420780 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 477/981] 10.222.0.49 () {58 vars in 1413 bytes} [Mon Sep 26 05:37:33 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments/b76e08a8-4d00-4e07-9e55-ba3132bd01d9 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:33.432669 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-41bdc062-0b6a-404e-a1ed-73cd44d2d885 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:33.433436 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-41bdc062-0b6a-404e-a1ed-73cd44d2d885 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:33.443356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-41bdc062-0b6a-404e-a1ed-73cd44d2d885 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:33.445327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-41bdc062-0b6a-404e-a1ed-73cd44d2d885 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:33.446833 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-41bdc062-0b6a-404e-a1ed-73cd44d2d885 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:33.447567 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-41bdc062-0b6a-404e-a1ed-73cd44d2d885 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:33.448032 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-41bdc062-0b6a-404e-a1ed-73cd44d2d885 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:33.448493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-41bdc062-0b6a-404e-a1ed-73cd44d2d885 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:33.624596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-41bdc062-0b6a-404e-a1ed-73cd44d2d885 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lazy-loading 'services' on Instance uuid 69ae32da-8cf7-4b65-9387-3d013453dbe5 {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:37:33.725882 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-41bdc062-0b6a-404e-a1ed-73cd44d2d885 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "DELETE /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments/b76e08a8-4d00-4e07-9e55-ba3132bd01d9" status: 202 len: 0 microversion: 2.1 time: 0.298147 Sep 26 05:37:33.734786 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 505/982] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 05:37:33 2022] DELETE /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments/b76e08a8-4d00-4e07-9e55-ba3132bd01d9 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:37:33.787977 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7b037e83-dc36-4f85-8c9d-662b1a44fc96 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:33.788875 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7b037e83-dc36-4f85-8c9d-662b1a44fc96 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:33.813988 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7b037e83-dc36-4f85-8c9d-662b1a44fc96 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:33.814634 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7b037e83-dc36-4f85-8c9d-662b1a44fc96 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:33.815094 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7b037e83-dc36-4f85-8c9d-662b1a44fc96 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:33.816473 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7b037e83-dc36-4f85-8c9d-662b1a44fc96 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:33.817257 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7b037e83-dc36-4f85-8c9d-662b1a44fc96 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:33.818047 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7b037e83-dc36-4f85-8c9d-662b1a44fc96 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:34.015673 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7b037e83-dc36-4f85-8c9d-662b1a44fc96 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:34.024376 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7b037e83-dc36-4f85-8c9d-662b1a44fc96 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.241813 Sep 26 05:37:34.025592 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 478/983] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:33 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:35.050542 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7d0a1ba7-cc9a-46b5-8488-3e3e30a35372 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:35.051242 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7d0a1ba7-cc9a-46b5-8488-3e3e30a35372 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:35.064488 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7d0a1ba7-cc9a-46b5-8488-3e3e30a35372 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:35.064976 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7d0a1ba7-cc9a-46b5-8488-3e3e30a35372 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:35.065408 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7d0a1ba7-cc9a-46b5-8488-3e3e30a35372 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:35.066106 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7d0a1ba7-cc9a-46b5-8488-3e3e30a35372 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:35.066585 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7d0a1ba7-cc9a-46b5-8488-3e3e30a35372 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:35.066971 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7d0a1ba7-cc9a-46b5-8488-3e3e30a35372 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:35.261600 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7d0a1ba7-cc9a-46b5-8488-3e3e30a35372 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:35.276902 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7d0a1ba7-cc9a-46b5-8488-3e3e30a35372 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.227505 Sep 26 05:37:35.278018 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 506/984] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:35 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:36.300815 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c4a0c1de-8982-4348-bc3d-991386cd2ec3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:36.301446 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c4a0c1de-8982-4348-bc3d-991386cd2ec3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:36.308770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4a0c1de-8982-4348-bc3d-991386cd2ec3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:36.310869 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4a0c1de-8982-4348-bc3d-991386cd2ec3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:36.316184 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4a0c1de-8982-4348-bc3d-991386cd2ec3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:36.317124 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4a0c1de-8982-4348-bc3d-991386cd2ec3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:36.317752 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4a0c1de-8982-4348-bc3d-991386cd2ec3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:36.318361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4a0c1de-8982-4348-bc3d-991386cd2ec3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:36.324015 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:36.484470 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c4a0c1de-8982-4348-bc3d-991386cd2ec3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:36.492117 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c4a0c1de-8982-4348-bc3d-991386cd2ec3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.195248 Sep 26 05:37:36.492703 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 479/985] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:36 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:36.546038 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-069ecb79-c1fb-4389-a9f8-c72aeb1cad5f tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Action: 'create', calling method: .version_select at 0x7fd7b721b790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1358970797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAoEUyJUGQG0iNL12Vo7AWmA24f/U/7+mK7Hx0JEEh9/2j9oJmyTpfv1cqAKGWhDiRZW9hO/0/SA3nmqLWUn/E9H4M/9xCYuADV07GFOY2HPhJiWupCRKaJW7NZhn5qUw=="}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:36.561782 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-069ecb79-c1fb-4389-a9f8-c72aeb1cad5f tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Getting quotas for project acb97fc9f6ca4cc3970ba2192c2fa3c1. Resources: {'key_pairs'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:37:36.565545 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-069ecb79-c1fb-4389-a9f8-c72aeb1cad5f tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Getting quotas for user 12f9f5e7d546480ea24913421273d9b4 and project acb97fc9f6ca4cc3970ba2192c2fa3c1. Resources: {'key_pairs'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:37:36.588024 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-069ecb79-c1fb-4389-a9f8-c72aeb1cad5f tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.046204 Sep 26 05:37:36.588641 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 507/986] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 05:37:36 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:36.686450 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9e9f2970-a3b2-4433-85d5-70006ef3a21e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-168031086", "imageRef": "6f842bb1-d029-4cfe-af7a-0553d61c18c9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1358970797", "networks": [{"uuid": "2cdfbef8-3db4-4a36-ab54-ecc69109c8d7"}]}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:36.738324 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-9e9f2970-a3b2-4433-85d5-70006ef3a21e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] validate_networks() for [('2cdfbef8-3db4-4a36-ab54-ecc69109c8d7', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:37:37.138758 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-9e9f2970-a3b2-4433-85d5-70006ef3a21e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:37:37.139180 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-9e9f2970-a3b2-4433-85d5-70006ef3a21e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:37:37.139657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-9e9f2970-a3b2-4433-85d5-70006ef3a21e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:37:37.140060 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-9e9f2970-a3b2-4433-85d5-70006ef3a21e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:37:37.140512 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-9e9f2970-a3b2-4433-85d5-70006ef3a21e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:37:37.149808 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e9f2970-a3b2-4433-85d5-70006ef3a21e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:37.150450 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e9f2970-a3b2-4433-85d5-70006ef3a21e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:37.150890 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e9f2970-a3b2-4433-85d5-70006ef3a21e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:37.151614 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e9f2970-a3b2-4433-85d5-70006ef3a21e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:37.152063 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e9f2970-a3b2-4433-85d5-70006ef3a21e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:37.152516 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e9f2970-a3b2-4433-85d5-70006ef3a21e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:37.170983 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-9e9f2970-a3b2-4433-85d5-70006ef3a21e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Getting quotas for project acb97fc9f6ca4cc3970ba2192c2fa3c1. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:37:37.174789 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-9e9f2970-a3b2-4433-85d5-70006ef3a21e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Getting quotas for user 12f9f5e7d546480ea24913421273d9b4 and project acb97fc9f6ca4cc3970ba2192c2fa3c1. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:37:37.189714 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9e9f2970-a3b2-4433-85d5-70006ef3a21e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:37:37.191818 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9e9f2970-a3b2-4433-85d5-70006ef3a21e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f842bb1-d029-4cfe-af7a-0553d61c18c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:37:37.246432 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9e9f2970-a3b2-4433-85d5-70006ef3a21e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564222 Sep 26 05:37:37.247329 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 480/987] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:37:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:37:37.258666 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-009c8440-a186-4110-9666-f406e3174e39 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:37.259291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-009c8440-a186-4110-9666-f406e3174e39 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:37.315623 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-009c8440-a186-4110-9666-f406e3174e39 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:37.326624 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-009c8440-a186-4110-9666-f406e3174e39 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1258 microversion: 2.1 time: 0.072004 Sep 26 05:37:37.327427 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 508/988] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:37 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:37.519340 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ada1d38f-50c4-406a-b79b-046c6736f3a6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:37.519983 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ada1d38f-50c4-406a-b79b-046c6736f3a6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:37.528653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ada1d38f-50c4-406a-b79b-046c6736f3a6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:37.528972 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ada1d38f-50c4-406a-b79b-046c6736f3a6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:37.529875 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ada1d38f-50c4-406a-b79b-046c6736f3a6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:37.530878 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ada1d38f-50c4-406a-b79b-046c6736f3a6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:37.531882 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ada1d38f-50c4-406a-b79b-046c6736f3a6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:37.532380 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ada1d38f-50c4-406a-b79b-046c6736f3a6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:37.733667 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ada1d38f-50c4-406a-b79b-046c6736f3a6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:37.743279 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ada1d38f-50c4-406a-b79b-046c6736f3a6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.231397 Sep 26 05:37:37.743885 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 481/989] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:37 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:38.139652 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-16c9ef60-53db-4a3b-8764-47625cb34b63 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:38.140193 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-16c9ef60-53db-4a3b-8764-47625cb34b63 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:38.146542 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-16c9ef60-53db-4a3b-8764-47625cb34b63 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:38.147025 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-16c9ef60-53db-4a3b-8764-47625cb34b63 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:38.147459 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-16c9ef60-53db-4a3b-8764-47625cb34b63 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:38.148147 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-16c9ef60-53db-4a3b-8764-47625cb34b63 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:38.148690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-16c9ef60-53db-4a3b-8764-47625cb34b63 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:38.149115 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-16c9ef60-53db-4a3b-8764-47625cb34b63 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:38.179004 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-16c9ef60-53db-4a3b-8764-47625cb34b63 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments/d7e3b4e7-0ecc-4a66-a7fd-54c113aaab5e" status: 200 len: 194 microversion: 2.1 time: 0.043345 Sep 26 05:37:38.179583 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 509/990] 10.222.0.49 () {58 vars in 1413 bytes} [Mon Sep 26 05:37:38 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments/d7e3b4e7-0ecc-4a66-a7fd-54c113aaab5e => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:38.190123 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c5c45747-950c-4517-86b9-ec6e14319f50 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:38.190618 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c5c45747-950c-4517-86b9-ec6e14319f50 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:38.196493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c5c45747-950c-4517-86b9-ec6e14319f50 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:38.196973 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c5c45747-950c-4517-86b9-ec6e14319f50 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:38.197413 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c5c45747-950c-4517-86b9-ec6e14319f50 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:38.198093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c5c45747-950c-4517-86b9-ec6e14319f50 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:38.198541 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c5c45747-950c-4517-86b9-ec6e14319f50 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:38.198961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c5c45747-950c-4517-86b9-ec6e14319f50 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:38.282126 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-c5c45747-950c-4517-86b9-ec6e14319f50 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lazy-loading 'services' on Instance uuid 69ae32da-8cf7-4b65-9387-3d013453dbe5 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:37:38.351718 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-74883017-ce19-4d97-b5bd-5b61c24fe9f0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:38.352367 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-74883017-ce19-4d97-b5bd-5b61c24fe9f0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:38.358255 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c5c45747-950c-4517-86b9-ec6e14319f50 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "DELETE /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments/d7e3b4e7-0ecc-4a66-a7fd-54c113aaab5e" status: 202 len: 0 microversion: 2.1 time: 0.171914 Sep 26 05:37:38.358862 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 482/991] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 05:37:38 2022] DELETE /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments/d7e3b4e7-0ecc-4a66-a7fd-54c113aaab5e => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:37:38.359439 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-74883017-ce19-4d97-b5bd-5b61c24fe9f0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:38.359929 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-74883017-ce19-4d97-b5bd-5b61c24fe9f0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:38.360393 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-74883017-ce19-4d97-b5bd-5b61c24fe9f0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:38.361088 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-74883017-ce19-4d97-b5bd-5b61c24fe9f0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:38.361535 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-74883017-ce19-4d97-b5bd-5b61c24fe9f0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:38.361955 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-74883017-ce19-4d97-b5bd-5b61c24fe9f0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:38.424681 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-74883017-ce19-4d97-b5bd-5b61c24fe9f0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:38.432657 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-74883017-ce19-4d97-b5bd-5b61c24fe9f0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1310 microversion: 2.1 time: 0.085351 Sep 26 05:37:38.433244 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 510/992] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:38 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:38.768021 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fabab5da-b706-42e7-b0e0-e9e42ce32ce6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:38.768756 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fabab5da-b706-42e7-b0e0-e9e42ce32ce6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:38.775288 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fabab5da-b706-42e7-b0e0-e9e42ce32ce6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:38.775766 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fabab5da-b706-42e7-b0e0-e9e42ce32ce6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:38.776201 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fabab5da-b706-42e7-b0e0-e9e42ce32ce6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:38.776908 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fabab5da-b706-42e7-b0e0-e9e42ce32ce6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:38.777356 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fabab5da-b706-42e7-b0e0-e9e42ce32ce6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:38.777779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fabab5da-b706-42e7-b0e0-e9e42ce32ce6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:38.914435 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fabab5da-b706-42e7-b0e0-e9e42ce32ce6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:38.923337 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fabab5da-b706-42e7-b0e0-e9e42ce32ce6 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.159965 Sep 26 05:37:38.923892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 483/993] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:38 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:39.456798 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d5d3034a-ea69-4049-9bd7-afaa14dfb10f tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:39.457384 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d5d3034a-ea69-4049-9bd7-afaa14dfb10f tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:39.464400 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d5d3034a-ea69-4049-9bd7-afaa14dfb10f tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:39.464897 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d5d3034a-ea69-4049-9bd7-afaa14dfb10f tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:39.465358 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d5d3034a-ea69-4049-9bd7-afaa14dfb10f tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:39.466059 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d5d3034a-ea69-4049-9bd7-afaa14dfb10f tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:39.466508 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d5d3034a-ea69-4049-9bd7-afaa14dfb10f tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:39.467566 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d5d3034a-ea69-4049-9bd7-afaa14dfb10f tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:39.533910 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d5d3034a-ea69-4049-9bd7-afaa14dfb10f tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:39.541965 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d5d3034a-ea69-4049-9bd7-afaa14dfb10f tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1310 microversion: 2.1 time: 0.088913 Sep 26 05:37:39.542543 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 511/994] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:39 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:39.946109 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6883e037-a7f9-4253-830f-f4374668bb99 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:39.947055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6883e037-a7f9-4253-830f-f4374668bb99 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:39.954967 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6883e037-a7f9-4253-830f-f4374668bb99 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:39.955460 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6883e037-a7f9-4253-830f-f4374668bb99 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:39.955898 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6883e037-a7f9-4253-830f-f4374668bb99 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:39.956629 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6883e037-a7f9-4253-830f-f4374668bb99 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:39.957090 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6883e037-a7f9-4253-830f-f4374668bb99 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:39.957514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6883e037-a7f9-4253-830f-f4374668bb99 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:40.096238 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6883e037-a7f9-4253-830f-f4374668bb99 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:40.104191 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6883e037-a7f9-4253-830f-f4374668bb99 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.162455 Sep 26 05:37:40.105024 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 484/995] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:39 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:40.566059 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b7ef33ac-a866-4d12-90a1-c60353339095 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:40.566681 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b7ef33ac-a866-4d12-90a1-c60353339095 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:40.572893 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b7ef33ac-a866-4d12-90a1-c60353339095 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:40.573566 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b7ef33ac-a866-4d12-90a1-c60353339095 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:40.573863 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b7ef33ac-a866-4d12-90a1-c60353339095 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:40.574615 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b7ef33ac-a866-4d12-90a1-c60353339095 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:40.575066 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b7ef33ac-a866-4d12-90a1-c60353339095 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:40.575484 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b7ef33ac-a866-4d12-90a1-c60353339095 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:40.636584 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b7ef33ac-a866-4d12-90a1-c60353339095 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:40.645271 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b7ef33ac-a866-4d12-90a1-c60353339095 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1310 microversion: 2.1 time: 0.083416 Sep 26 05:37:40.646192 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 512/996] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:40 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:41.127878 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8f0e3af6-c1bb-4a78-9a08-a6103b182142 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:41.128522 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8f0e3af6-c1bb-4a78-9a08-a6103b182142 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:41.135646 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8f0e3af6-c1bb-4a78-9a08-a6103b182142 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:41.136138 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8f0e3af6-c1bb-4a78-9a08-a6103b182142 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:41.136600 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8f0e3af6-c1bb-4a78-9a08-a6103b182142 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:41.137301 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8f0e3af6-c1bb-4a78-9a08-a6103b182142 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:41.137754 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8f0e3af6-c1bb-4a78-9a08-a6103b182142 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:41.138178 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8f0e3af6-c1bb-4a78-9a08-a6103b182142 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:41.288486 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8f0e3af6-c1bb-4a78-9a08-a6103b182142 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:41.298427 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8f0e3af6-c1bb-4a78-9a08-a6103b182142 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.175179 Sep 26 05:37:41.299594 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 485/997] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:41 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:41.668140 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-30092f1e-6ee0-472d-b3a3-e152d5d0f3b9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:41.669065 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-30092f1e-6ee0-472d-b3a3-e152d5d0f3b9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:41.675832 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-30092f1e-6ee0-472d-b3a3-e152d5d0f3b9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:41.676466 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-30092f1e-6ee0-472d-b3a3-e152d5d0f3b9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:41.676983 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-30092f1e-6ee0-472d-b3a3-e152d5d0f3b9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:41.677782 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-30092f1e-6ee0-472d-b3a3-e152d5d0f3b9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:41.678246 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-30092f1e-6ee0-472d-b3a3-e152d5d0f3b9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:41.678742 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-30092f1e-6ee0-472d-b3a3-e152d5d0f3b9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:41.760471 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-30092f1e-6ee0-472d-b3a3-e152d5d0f3b9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:41.778158 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-30092f1e-6ee0-472d-b3a3-e152d5d0f3b9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1318 microversion: 2.1 time: 0.113897 Sep 26 05:37:41.780239 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 513/998] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:41 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1318 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:42.323133 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f19bbf5d-ace5-4cb2-a4ad-aa94b3a567de tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:42.323744 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f19bbf5d-ace5-4cb2-a4ad-aa94b3a567de tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:42.326596 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:42.347481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f19bbf5d-ace5-4cb2-a4ad-aa94b3a567de tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:42.348014 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f19bbf5d-ace5-4cb2-a4ad-aa94b3a567de tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:42.348489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f19bbf5d-ace5-4cb2-a4ad-aa94b3a567de tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:42.351803 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f19bbf5d-ace5-4cb2-a4ad-aa94b3a567de tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:42.352335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f19bbf5d-ace5-4cb2-a4ad-aa94b3a567de tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:42.352805 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f19bbf5d-ace5-4cb2-a4ad-aa94b3a567de tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:42.715368 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f19bbf5d-ace5-4cb2-a4ad-aa94b3a567de tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:42.726714 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f19bbf5d-ace5-4cb2-a4ad-aa94b3a567de tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.407354 Sep 26 05:37:42.728591 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 486/999] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:42 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:42.790319 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-4043875e-e8ee-429e-8462-252f2d9e28bf tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:42.793598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-4043875e-e8ee-429e-8462-252f2d9e28bf tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:42.805393 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-caee4b47-5472-40e5-b366-e8bb1b7444d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:42.806001 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-caee4b47-5472-40e5-b366-e8bb1b7444d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:42.813963 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-caee4b47-5472-40e5-b366-e8bb1b7444d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:42.814710 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-caee4b47-5472-40e5-b366-e8bb1b7444d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:42.815313 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-caee4b47-5472-40e5-b366-e8bb1b7444d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:42.816144 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:42.816435 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-caee4b47-5472-40e5-b366-e8bb1b7444d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:42.817053 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-caee4b47-5472-40e5-b366-e8bb1b7444d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:42.817785 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-caee4b47-5472-40e5-b366-e8bb1b7444d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:42.818431 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4043875e-e8ee-429e-8462-252f2d9e28bf tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:42.819189 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4043875e-e8ee-429e-8462-252f2d9e28bf tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:42.819636 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4043875e-e8ee-429e-8462-252f2d9e28bf tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:42.820494 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4043875e-e8ee-429e-8462-252f2d9e28bf tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:42.820950 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4043875e-e8ee-429e-8462-252f2d9e28bf tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:42.821667 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-4043875e-e8ee-429e-8462-252f2d9e28bf tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:42.872383 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-4043875e-e8ee-429e-8462-252f2d9e28bf tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089880 Sep 26 05:37:42.874581 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 514/1000] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:37:42 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 26 05:37:43.020757 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-caee4b47-5472-40e5-b366-e8bb1b7444d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:43.029055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-caee4b47-5472-40e5-b366-e8bb1b7444d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.227887 Sep 26 05:37:43.046315 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 487/1001] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:42 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:43.080661 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-024a810e-609d-4811-924b-bf7aae30fd55 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:43.083282 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-024a810e-609d-4811-924b-bf7aae30fd55 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:43.095365 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-024a810e-609d-4811-924b-bf7aae30fd55 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:43.097417 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-024a810e-609d-4811-924b-bf7aae30fd55 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:43.098025 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-024a810e-609d-4811-924b-bf7aae30fd55 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:43.098913 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-024a810e-609d-4811-924b-bf7aae30fd55 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:43.099979 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-024a810e-609d-4811-924b-bf7aae30fd55 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:43.100584 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-024a810e-609d-4811-924b-bf7aae30fd55 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:43.153067 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-024a810e-609d-4811-924b-bf7aae30fd55 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077164 Sep 26 05:37:43.154896 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 515/1002] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:37:43 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:37:43.256679 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-95ee5642-0008-4d51-84d5-d9de73563902 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:43.257481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-95ee5642-0008-4d51-84d5-d9de73563902 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:43.265305 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95ee5642-0008-4d51-84d5-d9de73563902 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:43.266335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95ee5642-0008-4d51-84d5-d9de73563902 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:43.271608 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95ee5642-0008-4d51-84d5-d9de73563902 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:43.276553 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95ee5642-0008-4d51-84d5-d9de73563902 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:43.277202 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95ee5642-0008-4d51-84d5-d9de73563902 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:43.278723 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-95ee5642-0008-4d51-84d5-d9de73563902 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:43.338839 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-95ee5642-0008-4d51-84d5-d9de73563902 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Going to try to terminate instance {{(pid=120805) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:37:43.494710 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-95ee5642-0008-4d51-84d5-d9de73563902 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "DELETE /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 204 len: 0 microversion: 2.1 time: 0.241392 Sep 26 05:37:43.496115 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 488/1003] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:37:43 2022] DELETE /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:37:43.507277 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-2d46d999-bc30-4e34-acee-eb2145d512af tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:43.508224 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-2d46d999-bc30-4e34-acee-eb2145d512af tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:43.517843 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2d46d999-bc30-4e34-acee-eb2145d512af tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:43.521283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2d46d999-bc30-4e34-acee-eb2145d512af tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:43.523556 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2d46d999-bc30-4e34-acee-eb2145d512af tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:43.524640 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2d46d999-bc30-4e34-acee-eb2145d512af tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:43.527266 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2d46d999-bc30-4e34-acee-eb2145d512af tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:43.528088 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2d46d999-bc30-4e34-acee-eb2145d512af tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:43.684792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-594bbe72-174e-4ca9-aeca-736edfb2eba8 req-4c789722-faf5-4f06-9933-279b23001a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6a2248-68b0-4336-ade5-c6c3b756cdae", "name": "network-vif-plugged", "status": "completed", "tag": "e47ebac1-d877-4ac1-8e2f-fb371cb2f895"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:43.719099 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-594bbe72-174e-4ca9-aeca-736edfb2eba8 req-4c789722-faf5-4f06-9933-279b23001a70 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:43.720419 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-594bbe72-174e-4ca9-aeca-736edfb2eba8 req-4c789722-faf5-4f06-9933-279b23001a70 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:43.720891 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-594bbe72-174e-4ca9-aeca-736edfb2eba8 req-4c789722-faf5-4f06-9933-279b23001a70 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:43.744015 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-594bbe72-174e-4ca9-aeca-736edfb2eba8 req-4c789722-faf5-4f06-9933-279b23001a70 service nova] Creating event network-vif-plugged:e47ebac1-d877-4ac1-8e2f-fb371cb2f895 for instance 1e6a2248-68b0-4336-ade5-c6c3b756cdae on hv-cinder-85918 Sep 26 05:37:43.756206 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-594bbe72-174e-4ca9-aeca-736edfb2eba8 req-4c789722-faf5-4f06-9933-279b23001a70 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097058 Sep 26 05:37:43.760334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 489/1004] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:37:43.766772 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-74b34cce-7d5e-4cf7-aba7-54cc9e613d09 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:43.767481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-74b34cce-7d5e-4cf7-aba7-54cc9e613d09 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:43.781702 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74b34cce-7d5e-4cf7-aba7-54cc9e613d09 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:43.782253 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74b34cce-7d5e-4cf7-aba7-54cc9e613d09 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:43.782797 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74b34cce-7d5e-4cf7-aba7-54cc9e613d09 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:43.783641 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74b34cce-7d5e-4cf7-aba7-54cc9e613d09 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:43.783973 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74b34cce-7d5e-4cf7-aba7-54cc9e613d09 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:43.784471 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74b34cce-7d5e-4cf7-aba7-54cc9e613d09 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:44.222375 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2d46d999-bc30-4e34-acee-eb2145d512af tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:44.230139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2d46d999-bc30-4e34-acee-eb2145d512af tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1671 microversion: 2.1 time: 0.727432 Sep 26 05:37:44.240941 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 516/1005] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:43 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1671 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:44.240941 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c77d8b9d-6bfd-49f6-8f48-c5c7ac2fda66 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:44.240941 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c77d8b9d-6bfd-49f6-8f48-c5c7ac2fda66 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:44.243379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c77d8b9d-6bfd-49f6-8f48-c5c7ac2fda66 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:44.243867 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c77d8b9d-6bfd-49f6-8f48-c5c7ac2fda66 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:44.244322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c77d8b9d-6bfd-49f6-8f48-c5c7ac2fda66 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:44.245017 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c77d8b9d-6bfd-49f6-8f48-c5c7ac2fda66 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:44.245467 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c77d8b9d-6bfd-49f6-8f48-c5c7ac2fda66 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:44.245885 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c77d8b9d-6bfd-49f6-8f48-c5c7ac2fda66 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:44.376792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-74b34cce-7d5e-4cf7-aba7-54cc9e613d09 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:44.384874 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-74b34cce-7d5e-4cf7-aba7-54cc9e613d09 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.622915 Sep 26 05:37:44.385570 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 490/1006] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:43 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:44.524139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-c77d8b9d-6bfd-49f6-8f48-c5c7ac2fda66 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:44.533312 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c77d8b9d-6bfd-49f6-8f48-c5c7ac2fda66 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.301582 Sep 26 05:37:44.533890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 517/1007] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:44 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:44.925210 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-79ee9665-eb80-41f6-a37c-1eb3c0c7a3a9 req-252afb84-96f6-4683-8dec-ad4cad654f7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2df85633-fcf8-4640-bfac-ffc0f55778ac", "tag": "3211bad3-a3ee-47c8-a87f-240818a7928b"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:44.934547 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-79ee9665-eb80-41f6-a37c-1eb3c0c7a3a9 req-252afb84-96f6-4683-8dec-ad4cad654f7f service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:44.935028 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-79ee9665-eb80-41f6-a37c-1eb3c0c7a3a9 req-252afb84-96f6-4683-8dec-ad4cad654f7f service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:44.935997 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-79ee9665-eb80-41f6-a37c-1eb3c0c7a3a9 req-252afb84-96f6-4683-8dec-ad4cad654f7f service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:44.947716 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-79ee9665-eb80-41f6-a37c-1eb3c0c7a3a9 req-252afb84-96f6-4683-8dec-ad4cad654f7f service nova] Creating event network-changed:3211bad3-a3ee-47c8-a87f-240818a7928b for instance 2df85633-fcf8-4640-bfac-ffc0f55778ac on hv-cinder-85918 Sep 26 05:37:44.953908 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-79ee9665-eb80-41f6-a37c-1eb3c0c7a3a9 req-252afb84-96f6-4683-8dec-ad4cad654f7f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032310 Sep 26 05:37:44.954820 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 491/1008] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:45.255386 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c56582c2-caca-4f72-8c13-6f65ffbd2f22 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:45.255991 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c56582c2-caca-4f72-8c13-6f65ffbd2f22 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:45.262386 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c56582c2-caca-4f72-8c13-6f65ffbd2f22 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:45.262866 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c56582c2-caca-4f72-8c13-6f65ffbd2f22 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:45.263336 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c56582c2-caca-4f72-8c13-6f65ffbd2f22 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:45.264648 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c56582c2-caca-4f72-8c13-6f65ffbd2f22 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:45.265101 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c56582c2-caca-4f72-8c13-6f65ffbd2f22 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:45.265522 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c56582c2-caca-4f72-8c13-6f65ffbd2f22 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:45.396978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-c56582c2-caca-4f72-8c13-6f65ffbd2f22 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:45.405437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c56582c2-caca-4f72-8c13-6f65ffbd2f22 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1671 microversion: 2.1 time: 0.153925 Sep 26 05:37:45.406007 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 518/1009] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:45 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:45.408502 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-14f7c28e-baa2-480a-a745-a51b13f3bfdd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:45.409206 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-14f7c28e-baa2-480a-a745-a51b13f3bfdd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:45.415570 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-14f7c28e-baa2-480a-a745-a51b13f3bfdd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:45.416053 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-14f7c28e-baa2-480a-a745-a51b13f3bfdd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:45.416686 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-14f7c28e-baa2-480a-a745-a51b13f3bfdd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:45.417660 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-14f7c28e-baa2-480a-a745-a51b13f3bfdd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:45.418288 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-14f7c28e-baa2-480a-a745-a51b13f3bfdd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:45.418714 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-14f7c28e-baa2-480a-a745-a51b13f3bfdd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:45.549849 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-14f7c28e-baa2-480a-a745-a51b13f3bfdd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:45.556845 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e2e779a3-1bd9-45d3-8fc5-ed1a29f24c24 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:45.557465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e2e779a3-1bd9-45d3-8fc5-ed1a29f24c24 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:45.557686 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-14f7c28e-baa2-480a-a745-a51b13f3bfdd tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.154059 Sep 26 05:37:45.558246 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 492/1010] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:45 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:45.564639 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e2e779a3-1bd9-45d3-8fc5-ed1a29f24c24 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:45.565322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e2e779a3-1bd9-45d3-8fc5-ed1a29f24c24 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:45.565866 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e2e779a3-1bd9-45d3-8fc5-ed1a29f24c24 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:45.566894 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e2e779a3-1bd9-45d3-8fc5-ed1a29f24c24 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:45.567358 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e2e779a3-1bd9-45d3-8fc5-ed1a29f24c24 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:45.567794 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e2e779a3-1bd9-45d3-8fc5-ed1a29f24c24 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:45.703113 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e2e779a3-1bd9-45d3-8fc5-ed1a29f24c24 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:45.710670 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e2e779a3-1bd9-45d3-8fc5-ed1a29f24c24 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.157636 Sep 26 05:37:45.711229 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 519/1011] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:45 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:46.430356 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-317fbd43-f43b-4e00-9df9-130f2f05251f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:46.430993 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-317fbd43-f43b-4e00-9df9-130f2f05251f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:46.438429 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-317fbd43-f43b-4e00-9df9-130f2f05251f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:46.438913 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-317fbd43-f43b-4e00-9df9-130f2f05251f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:46.439352 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-317fbd43-f43b-4e00-9df9-130f2f05251f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:46.440051 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-317fbd43-f43b-4e00-9df9-130f2f05251f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:46.440554 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-317fbd43-f43b-4e00-9df9-130f2f05251f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:46.440981 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-317fbd43-f43b-4e00-9df9-130f2f05251f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:46.568486 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-317fbd43-f43b-4e00-9df9-130f2f05251f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:46.576851 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-317fbd43-f43b-4e00-9df9-130f2f05251f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1671 microversion: 2.1 time: 0.149795 Sep 26 05:37:46.577419 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 493/1012] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:46 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:46.581478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d5cb1f55-517f-4852-919e-2444ea5dbbdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:46.582107 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d5cb1f55-517f-4852-919e-2444ea5dbbdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:46.589240 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d5cb1f55-517f-4852-919e-2444ea5dbbdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:46.589759 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d5cb1f55-517f-4852-919e-2444ea5dbbdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:46.590200 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d5cb1f55-517f-4852-919e-2444ea5dbbdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:46.590901 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d5cb1f55-517f-4852-919e-2444ea5dbbdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:46.591365 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d5cb1f55-517f-4852-919e-2444ea5dbbdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:46.592039 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d5cb1f55-517f-4852-919e-2444ea5dbbdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:46.611808 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:46.735376 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d6335ac0-3353-40ad-b348-d0ec418a0f92 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:46.735909 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d5cb1f55-517f-4852-919e-2444ea5dbbdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:46.736282 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d6335ac0-3353-40ad-b348-d0ec418a0f92 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:46.742350 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d6335ac0-3353-40ad-b348-d0ec418a0f92 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:46.742838 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d6335ac0-3353-40ad-b348-d0ec418a0f92 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:46.743267 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d6335ac0-3353-40ad-b348-d0ec418a0f92 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:46.743794 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d5cb1f55-517f-4852-919e-2444ea5dbbdf tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.166173 Sep 26 05:37:46.743951 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d6335ac0-3353-40ad-b348-d0ec418a0f92 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:46.744376 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 520/1013] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:46 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:46.744498 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d6335ac0-3353-40ad-b348-d0ec418a0f92 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:46.744839 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d6335ac0-3353-40ad-b348-d0ec418a0f92 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:46.877062 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d6335ac0-3353-40ad-b348-d0ec418a0f92 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:46.884587 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d6335ac0-3353-40ad-b348-d0ec418a0f92 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.154115 Sep 26 05:37:46.885146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 494/1014] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:46 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:47.600666 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a3d5475c-d9bc-40b7-a4c0-21cfb575f65c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:47.601280 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a3d5475c-d9bc-40b7-a4c0-21cfb575f65c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:47.603171 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=6 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:47.609911 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a3d5475c-d9bc-40b7-a4c0-21cfb575f65c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:47.610376 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a3d5475c-d9bc-40b7-a4c0-21cfb575f65c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:47.610818 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a3d5475c-d9bc-40b7-a4c0-21cfb575f65c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:47.611528 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a3d5475c-d9bc-40b7-a4c0-21cfb575f65c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:47.611989 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a3d5475c-d9bc-40b7-a4c0-21cfb575f65c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:47.612448 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a3d5475c-d9bc-40b7-a4c0-21cfb575f65c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:47.771152 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-74bc9ae7-735d-4994-bce9-4b510935671b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:47.771806 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-74bc9ae7-735d-4994-bce9-4b510935671b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:47.777926 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:47.778748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=6 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:47.782106 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74bc9ae7-735d-4994-bce9-4b510935671b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:47.782607 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74bc9ae7-735d-4994-bce9-4b510935671b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:47.783047 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74bc9ae7-735d-4994-bce9-4b510935671b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:47.783750 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74bc9ae7-735d-4994-bce9-4b510935671b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:47.784205 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74bc9ae7-735d-4994-bce9-4b510935671b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:47.784661 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74bc9ae7-735d-4994-bce9-4b510935671b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:47.801736 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a3d5475c-d9bc-40b7-a4c0-21cfb575f65c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:47.818906 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a3d5475c-d9bc-40b7-a4c0-21cfb575f65c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1671 microversion: 2.1 time: 0.222226 Sep 26 05:37:47.819681 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 521/1015] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:47 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1671 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:47.849200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:47.908752 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-2e7759fa-8a0c-4154-bc73-cb620bb8d234 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:47.909437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-2e7759fa-8a0c-4154-bc73-cb620bb8d234 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:47.916777 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2e7759fa-8a0c-4154-bc73-cb620bb8d234 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:47.917477 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2e7759fa-8a0c-4154-bc73-cb620bb8d234 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:47.917858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2e7759fa-8a0c-4154-bc73-cb620bb8d234 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:47.918559 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2e7759fa-8a0c-4154-bc73-cb620bb8d234 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:47.919069 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2e7759fa-8a0c-4154-bc73-cb620bb8d234 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:47.919558 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2e7759fa-8a0c-4154-bc73-cb620bb8d234 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:48.112894 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-74bc9ae7-735d-4994-bce9-4b510935671b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:48.142499 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-74bc9ae7-735d-4994-bce9-4b510935671b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.376448 Sep 26 05:37:48.151255 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 495/1016] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:47 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:48.181470 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2e7759fa-8a0c-4154-bc73-cb620bb8d234 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:48.190142 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2e7759fa-8a0c-4154-bc73-cb620bb8d234 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.286103 Sep 26 05:37:48.192292 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 522/1017] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:47 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:48.843117 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-201be504-6d21-48d7-85ce-66fbee4aee3d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:48.843708 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-201be504-6d21-48d7-85ce-66fbee4aee3d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:48.850554 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-201be504-6d21-48d7-85ce-66fbee4aee3d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:48.851037 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-201be504-6d21-48d7-85ce-66fbee4aee3d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:48.851469 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-201be504-6d21-48d7-85ce-66fbee4aee3d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:48.852160 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-201be504-6d21-48d7-85ce-66fbee4aee3d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:48.852638 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-201be504-6d21-48d7-85ce-66fbee4aee3d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:48.853059 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-201be504-6d21-48d7-85ce-66fbee4aee3d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:48.999286 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-201be504-6d21-48d7-85ce-66fbee4aee3d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:49.008000 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-201be504-6d21-48d7-85ce-66fbee4aee3d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1671 microversion: 2.1 time: 0.168861 Sep 26 05:37:49.008864 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 496/1018] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:48 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:49.178035 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-24a51f3c-c9f6-4532-a3df-ba931f2c4412 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:49.178660 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-24a51f3c-c9f6-4532-a3df-ba931f2c4412 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:49.190215 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-24a51f3c-c9f6-4532-a3df-ba931f2c4412 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:49.190714 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-24a51f3c-c9f6-4532-a3df-ba931f2c4412 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:49.191156 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-24a51f3c-c9f6-4532-a3df-ba931f2c4412 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:49.192361 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-24a51f3c-c9f6-4532-a3df-ba931f2c4412 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:49.192831 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-24a51f3c-c9f6-4532-a3df-ba931f2c4412 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:49.193354 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-24a51f3c-c9f6-4532-a3df-ba931f2c4412 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:49.214746 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5e3aac39-685a-488d-b321-675fdd4b3d7d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:49.215629 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5e3aac39-685a-488d-b321-675fdd4b3d7d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:49.227661 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e3aac39-685a-488d-b321-675fdd4b3d7d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:49.230244 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e3aac39-685a-488d-b321-675fdd4b3d7d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:49.230961 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e3aac39-685a-488d-b321-675fdd4b3d7d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:49.232793 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e3aac39-685a-488d-b321-675fdd4b3d7d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:49.237264 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e3aac39-685a-488d-b321-675fdd4b3d7d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:49.237783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5e3aac39-685a-488d-b321-675fdd4b3d7d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:49.465536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5e3aac39-685a-488d-b321-675fdd4b3d7d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:49.475945 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-24a51f3c-c9f6-4532-a3df-ba931f2c4412 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:49.476407 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5e3aac39-685a-488d-b321-675fdd4b3d7d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.266571 Sep 26 05:37:49.485843 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-24a51f3c-c9f6-4532-a3df-ba931f2c4412 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.310902 Sep 26 05:37:49.500276 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 497/1019] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:49 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:49.502276 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 523/1020] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:49 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:50.034031 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8b8625a1-217c-4721-a5bc-144b8a03595a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:50.035416 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8b8625a1-217c-4721-a5bc-144b8a03595a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:50.042742 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8b8625a1-217c-4721-a5bc-144b8a03595a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:50.043294 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8b8625a1-217c-4721-a5bc-144b8a03595a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:50.043736 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8b8625a1-217c-4721-a5bc-144b8a03595a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:50.044492 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8b8625a1-217c-4721-a5bc-144b8a03595a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:50.044978 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8b8625a1-217c-4721-a5bc-144b8a03595a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:50.045410 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8b8625a1-217c-4721-a5bc-144b8a03595a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:50.192936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8b8625a1-217c-4721-a5bc-144b8a03595a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:50.202387 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8b8625a1-217c-4721-a5bc-144b8a03595a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1671 microversion: 2.1 time: 0.170798 Sep 26 05:37:50.202387 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 498/1021] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:50 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:50.503425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5fe6492a-f890-4e7f-85af-2bc783e71e47 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:50.504034 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5fe6492a-f890-4e7f-85af-2bc783e71e47 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:50.510343 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9a81698d-43ee-4990-bba7-e64a3a315ca0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:50.510528 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5fe6492a-f890-4e7f-85af-2bc783e71e47 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:50.510963 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9a81698d-43ee-4990-bba7-e64a3a315ca0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:50.511084 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5fe6492a-f890-4e7f-85af-2bc783e71e47 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:50.511422 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5fe6492a-f890-4e7f-85af-2bc783e71e47 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:50.512103 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5fe6492a-f890-4e7f-85af-2bc783e71e47 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:50.512578 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5fe6492a-f890-4e7f-85af-2bc783e71e47 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:50.513487 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5fe6492a-f890-4e7f-85af-2bc783e71e47 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:50.517613 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9a81698d-43ee-4990-bba7-e64a3a315ca0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:50.518102 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9a81698d-43ee-4990-bba7-e64a3a315ca0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:50.518548 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9a81698d-43ee-4990-bba7-e64a3a315ca0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:50.519242 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9a81698d-43ee-4990-bba7-e64a3a315ca0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:50.519700 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9a81698d-43ee-4990-bba7-e64a3a315ca0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:50.520130 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9a81698d-43ee-4990-bba7-e64a3a315ca0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:50.727824 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9a81698d-43ee-4990-bba7-e64a3a315ca0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:50.731642 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5fe6492a-f890-4e7f-85af-2bc783e71e47 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:50.736738 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9a81698d-43ee-4990-bba7-e64a3a315ca0 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.230058 Sep 26 05:37:50.737335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 499/1022] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:50 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:50.740398 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5fe6492a-f890-4e7f-85af-2bc783e71e47 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.240724 Sep 26 05:37:50.741228 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 524/1023] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:50 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:51.228405 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2eb90c39-a336-4303-b2b1-5c42178c1a77 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:51.229024 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2eb90c39-a336-4303-b2b1-5c42178c1a77 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:51.236174 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2eb90c39-a336-4303-b2b1-5c42178c1a77 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:51.236695 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2eb90c39-a336-4303-b2b1-5c42178c1a77 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:51.237135 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2eb90c39-a336-4303-b2b1-5c42178c1a77 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:51.237841 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2eb90c39-a336-4303-b2b1-5c42178c1a77 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:51.238280 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2eb90c39-a336-4303-b2b1-5c42178c1a77 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:51.238707 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2eb90c39-a336-4303-b2b1-5c42178c1a77 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:51.382573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2eb90c39-a336-4303-b2b1-5c42178c1a77 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:51.390981 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2eb90c39-a336-4303-b2b1-5c42178c1a77 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1671 microversion: 2.1 time: 0.166466 Sep 26 05:37:51.391544 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 500/1024] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:51 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:51.760837 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1bd5cb1a-9f7b-4d7e-84c9-46702a5eb3da tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:51.761475 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-1bd5cb1a-9f7b-4d7e-84c9-46702a5eb3da tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:51.762766 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-36d18c4a-d8ad-4f21-a929-d37480640de1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:51.764070 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-36d18c4a-d8ad-4f21-a929-d37480640de1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:51.769481 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1bd5cb1a-9f7b-4d7e-84c9-46702a5eb3da tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:51.770179 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1bd5cb1a-9f7b-4d7e-84c9-46702a5eb3da tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:51.770295 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-36d18c4a-d8ad-4f21-a929-d37480640de1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:51.770675 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-36d18c4a-d8ad-4f21-a929-d37480640de1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:51.771118 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-36d18c4a-d8ad-4f21-a929-d37480640de1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:51.771300 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1bd5cb1a-9f7b-4d7e-84c9-46702a5eb3da tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:51.771827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-36d18c4a-d8ad-4f21-a929-d37480640de1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:51.772303 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-36d18c4a-d8ad-4f21-a929-d37480640de1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:51.772580 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1bd5cb1a-9f7b-4d7e-84c9-46702a5eb3da tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:51.772733 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-36d18c4a-d8ad-4f21-a929-d37480640de1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:51.773308 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1bd5cb1a-9f7b-4d7e-84c9-46702a5eb3da tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:51.773988 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1bd5cb1a-9f7b-4d7e-84c9-46702a5eb3da tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:51.969172 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-36d18c4a-d8ad-4f21-a929-d37480640de1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:51.977537 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-36d18c4a-d8ad-4f21-a929-d37480640de1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.218595 Sep 26 05:37:51.984646 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 501/1025] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:51 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:52.006817 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1bd5cb1a-9f7b-4d7e-84c9-46702a5eb3da tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:52.015054 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1bd5cb1a-9f7b-4d7e-84c9-46702a5eb3da tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.258122 Sep 26 05:37:52.015546 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 525/1026] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:51 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:52.416107 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5f33fe1a-0897-455a-8ba9-3ed819dc796e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:52.416857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5f33fe1a-0897-455a-8ba9-3ed819dc796e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:52.425593 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f33fe1a-0897-455a-8ba9-3ed819dc796e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:52.426080 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f33fe1a-0897-455a-8ba9-3ed819dc796e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:52.426520 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f33fe1a-0897-455a-8ba9-3ed819dc796e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:52.427220 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f33fe1a-0897-455a-8ba9-3ed819dc796e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:52.427697 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f33fe1a-0897-455a-8ba9-3ed819dc796e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:52.428471 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f33fe1a-0897-455a-8ba9-3ed819dc796e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:52.577671 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5f33fe1a-0897-455a-8ba9-3ed819dc796e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:52.585965 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5f33fe1a-0897-455a-8ba9-3ed819dc796e tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1671 microversion: 2.1 time: 0.174115 Sep 26 05:37:52.586469 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 502/1027] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:52 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:53.001318 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-df693754-ed6e-4371-bf9a-cbcd356f5f29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:53.002120 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-df693754-ed6e-4371-bf9a-cbcd356f5f29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:53.009114 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-df693754-ed6e-4371-bf9a-cbcd356f5f29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:53.009643 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-df693754-ed6e-4371-bf9a-cbcd356f5f29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:53.010051 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-df693754-ed6e-4371-bf9a-cbcd356f5f29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:53.010755 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-df693754-ed6e-4371-bf9a-cbcd356f5f29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:53.011211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-df693754-ed6e-4371-bf9a-cbcd356f5f29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:53.011640 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-df693754-ed6e-4371-bf9a-cbcd356f5f29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:53.037812 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-78e4e6cd-de17-4e39-a5fb-a9cc94d04023 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:53.038072 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-78e4e6cd-de17-4e39-a5fb-a9cc94d04023 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:53.044037 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-78e4e6cd-de17-4e39-a5fb-a9cc94d04023 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:53.044650 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-78e4e6cd-de17-4e39-a5fb-a9cc94d04023 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:53.045416 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-78e4e6cd-de17-4e39-a5fb-a9cc94d04023 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:53.046135 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-78e4e6cd-de17-4e39-a5fb-a9cc94d04023 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:53.046598 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-78e4e6cd-de17-4e39-a5fb-a9cc94d04023 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:53.047029 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-78e4e6cd-de17-4e39-a5fb-a9cc94d04023 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:53.228006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-df693754-ed6e-4371-bf9a-cbcd356f5f29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:53.231592 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-78e4e6cd-de17-4e39-a5fb-a9cc94d04023 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:53.235955 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-df693754-ed6e-4371-bf9a-cbcd356f5f29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.238998 Sep 26 05:37:53.236577 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 526/1028] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:52 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:53.240128 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-78e4e6cd-de17-4e39-a5fb-a9cc94d04023 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.206497 Sep 26 05:37:53.246459 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 503/1029] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:53 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:53.610879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-be87367c-34ff-400a-baa1-2bef54f4a81a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:53.611436 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-be87367c-34ff-400a-baa1-2bef54f4a81a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:53.617757 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-be87367c-34ff-400a-baa1-2bef54f4a81a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:53.618245 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-be87367c-34ff-400a-baa1-2bef54f4a81a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:53.618678 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-be87367c-34ff-400a-baa1-2bef54f4a81a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:53.619378 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-be87367c-34ff-400a-baa1-2bef54f4a81a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:53.619824 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-be87367c-34ff-400a-baa1-2bef54f4a81a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:53.620263 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-be87367c-34ff-400a-baa1-2bef54f4a81a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:53.980833 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-be87367c-34ff-400a-baa1-2bef54f4a81a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:53.989617 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-be87367c-34ff-400a-baa1-2bef54f4a81a tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1671 microversion: 2.1 time: 0.383338 Sep 26 05:37:53.990175 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 527/1030] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:53 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1671 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:54.260325 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5bedf2d2-cf63-486c-8cc6-ef39c3939eee tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:54.260325 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5bedf2d2-cf63-486c-8cc6-ef39c3939eee tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:54.265741 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-0f580579-ffdd-43fa-b0fb-9a82a61783ef tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:54.266359 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-0f580579-ffdd-43fa-b0fb-9a82a61783ef tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:54.267691 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5bedf2d2-cf63-486c-8cc6-ef39c3939eee tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:54.268193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5bedf2d2-cf63-486c-8cc6-ef39c3939eee tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:54.268656 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5bedf2d2-cf63-486c-8cc6-ef39c3939eee tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:54.269356 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5bedf2d2-cf63-486c-8cc6-ef39c3939eee tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:54.269814 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5bedf2d2-cf63-486c-8cc6-ef39c3939eee tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:54.270392 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5bedf2d2-cf63-486c-8cc6-ef39c3939eee tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:54.272628 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f580579-ffdd-43fa-b0fb-9a82a61783ef tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:54.273109 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f580579-ffdd-43fa-b0fb-9a82a61783ef tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:54.273539 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f580579-ffdd-43fa-b0fb-9a82a61783ef tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:54.274218 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f580579-ffdd-43fa-b0fb-9a82a61783ef tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:54.274670 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f580579-ffdd-43fa-b0fb-9a82a61783ef tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:54.275088 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0f580579-ffdd-43fa-b0fb-9a82a61783ef tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:54.499379 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5bedf2d2-cf63-486c-8cc6-ef39c3939eee tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:54.511898 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0f580579-ffdd-43fa-b0fb-9a82a61783ef tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:54.524667 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5bedf2d2-cf63-486c-8cc6-ef39c3939eee tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.268722 Sep 26 05:37:54.525362 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 504/1031] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:54 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:54.526746 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-0f580579-ffdd-43fa-b0fb-9a82a61783ef tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.265018 Sep 26 05:37:54.527298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 528/1032] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:54 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:55.019147 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9f1aa0e4-0335-4613-b03a-491ae827f06d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:55.019941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9f1aa0e4-0335-4613-b03a-491ae827f06d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:55.027894 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9f1aa0e4-0335-4613-b03a-491ae827f06d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:55.028949 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9f1aa0e4-0335-4613-b03a-491ae827f06d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:55.029862 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9f1aa0e4-0335-4613-b03a-491ae827f06d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:55.030826 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9f1aa0e4-0335-4613-b03a-491ae827f06d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:55.031451 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9f1aa0e4-0335-4613-b03a-491ae827f06d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:55.032323 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9f1aa0e4-0335-4613-b03a-491ae827f06d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:55.213002 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9f1aa0e4-0335-4613-b03a-491ae827f06d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:55.220869 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9f1aa0e4-0335-4613-b03a-491ae827f06d tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1671 microversion: 2.1 time: 0.209535 Sep 26 05:37:55.222035 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 505/1033] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:55 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1671 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:55.550396 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b530ed31-a449-417f-8659-6e3843296877 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:55.551962 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b530ed31-a449-417f-8659-6e3843296877 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:55.564532 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b530ed31-a449-417f-8659-6e3843296877 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:55.565026 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-be695c32-40b4-490e-87a4-a68b7dc1388c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:55.565989 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b530ed31-a449-417f-8659-6e3843296877 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:55.566487 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b530ed31-a449-417f-8659-6e3843296877 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:55.566888 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-be695c32-40b4-490e-87a4-a68b7dc1388c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:55.568596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b530ed31-a449-417f-8659-6e3843296877 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:55.569540 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b530ed31-a449-417f-8659-6e3843296877 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:55.570605 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b530ed31-a449-417f-8659-6e3843296877 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:55.593681 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-be695c32-40b4-490e-87a4-a68b7dc1388c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:55.594632 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-be695c32-40b4-490e-87a4-a68b7dc1388c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:55.595057 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-be695c32-40b4-490e-87a4-a68b7dc1388c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:55.595762 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-be695c32-40b4-490e-87a4-a68b7dc1388c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:55.597574 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-be695c32-40b4-490e-87a4-a68b7dc1388c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:55.599023 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-be695c32-40b4-490e-87a4-a68b7dc1388c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:55.804448 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b530ed31-a449-417f-8659-6e3843296877 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:55.819180 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b530ed31-a449-417f-8659-6e3843296877 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.273082 Sep 26 05:37:55.820234 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 529/1034] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:55 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:55.841821 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-be695c32-40b4-490e-87a4-a68b7dc1388c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:55.850705 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-be695c32-40b4-490e-87a4-a68b7dc1388c tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.293933 Sep 26 05:37:55.851288 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 506/1035] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:55 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:56.245088 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-baf2cf6f-81cb-48d4-a9ba-78dd07ffdd7f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:56.246042 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-baf2cf6f-81cb-48d4-a9ba-78dd07ffdd7f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:56.253087 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-baf2cf6f-81cb-48d4-a9ba-78dd07ffdd7f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:56.254091 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-baf2cf6f-81cb-48d4-a9ba-78dd07ffdd7f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:56.254634 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-baf2cf6f-81cb-48d4-a9ba-78dd07ffdd7f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:56.255467 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-baf2cf6f-81cb-48d4-a9ba-78dd07ffdd7f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:56.256018 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-baf2cf6f-81cb-48d4-a9ba-78dd07ffdd7f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:56.256578 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-baf2cf6f-81cb-48d4-a9ba-78dd07ffdd7f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:56.333683 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-f71b6d8a-a0ac-41e1-9e77-3f0fc3cd1d4a req-ad01fae0-8526-4238-ade8-bfc8119df910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ae32da-8cf7-4b65-9387-3d013453dbe5", "name": "network-vif-deleted", "tag": "5c2eb711-a069-49dc-aca7-800571583c6a"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:56.350424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-baf2cf6f-81cb-48d4-a9ba-78dd07ffdd7f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:56.353324 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-f71b6d8a-a0ac-41e1-9e77-3f0fc3cd1d4a req-ad01fae0-8526-4238-ade8-bfc8119df910 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:56.354013 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-f71b6d8a-a0ac-41e1-9e77-3f0fc3cd1d4a req-ad01fae0-8526-4238-ade8-bfc8119df910 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:56.354668 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-f71b6d8a-a0ac-41e1-9e77-3f0fc3cd1d4a req-ad01fae0-8526-4238-ade8-bfc8119df910 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:56.363925 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-baf2cf6f-81cb-48d4-a9ba-78dd07ffdd7f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1604 microversion: 2.1 time: 0.122421 Sep 26 05:37:56.364610 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 530/1036] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:56 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1604 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:56.369647 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-f71b6d8a-a0ac-41e1-9e77-3f0fc3cd1d4a req-ad01fae0-8526-4238-ade8-bfc8119df910 service nova] Creating event network-vif-deleted:5c2eb711-a069-49dc-aca7-800571583c6a for instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 on hv-cinder-85918 Sep 26 05:37:56.375338 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-f71b6d8a-a0ac-41e1-9e77-3f0fc3cd1d4a req-ad01fae0-8526-4238-ade8-bfc8119df910 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046712 Sep 26 05:37:56.376268 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 507/1037] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:37:56.846152 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-27a1c631-2192-4191-a9a5-a90e0e4435d7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:56.848097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-27a1c631-2192-4191-a9a5-a90e0e4435d7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:56.856064 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-27a1c631-2192-4191-a9a5-a90e0e4435d7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:56.857619 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-27a1c631-2192-4191-a9a5-a90e0e4435d7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:56.858350 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-27a1c631-2192-4191-a9a5-a90e0e4435d7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:56.859195 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-27a1c631-2192-4191-a9a5-a90e0e4435d7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:56.859985 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-27a1c631-2192-4191-a9a5-a90e0e4435d7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:56.860540 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-27a1c631-2192-4191-a9a5-a90e0e4435d7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:56.878810 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7a54e650-df7e-4f61-9896-d7beae13bc58 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:56.880484 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7a54e650-df7e-4f61-9896-d7beae13bc58 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:56.892080 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a54e650-df7e-4f61-9896-d7beae13bc58 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:56.892928 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a54e650-df7e-4f61-9896-d7beae13bc58 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:56.894400 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a54e650-df7e-4f61-9896-d7beae13bc58 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:56.895289 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a54e650-df7e-4f61-9896-d7beae13bc58 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:56.895918 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a54e650-df7e-4f61-9896-d7beae13bc58 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:56.896550 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a54e650-df7e-4f61-9896-d7beae13bc58 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:57.119539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7a54e650-df7e-4f61-9896-d7beae13bc58 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:57.126125 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-27a1c631-2192-4191-a9a5-a90e0e4435d7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:57.128778 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7a54e650-df7e-4f61-9896-d7beae13bc58 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.257824 Sep 26 05:37:57.129779 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 508/1038] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:56 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:57.134761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-27a1c631-2192-4191-a9a5-a90e0e4435d7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.294482 Sep 26 05:37:57.135314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 531/1039] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:56 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:57.389380 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3ffc7ea7-3187-4588-ae5c-84cd0b151b10 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:57.390025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3ffc7ea7-3187-4588-ae5c-84cd0b151b10 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:57.395948 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3ffc7ea7-3187-4588-ae5c-84cd0b151b10 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:57.396580 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3ffc7ea7-3187-4588-ae5c-84cd0b151b10 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:57.397015 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3ffc7ea7-3187-4588-ae5c-84cd0b151b10 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:57.397695 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3ffc7ea7-3187-4588-ae5c-84cd0b151b10 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:57.398146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3ffc7ea7-3187-4588-ae5c-84cd0b151b10 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:57.398567 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3ffc7ea7-3187-4588-ae5c-84cd0b151b10 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:57.459155 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3ffc7ea7-3187-4588-ae5c-84cd0b151b10 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:57.467042 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3ffc7ea7-3187-4588-ae5c-84cd0b151b10 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1604 microversion: 2.1 time: 0.081599 Sep 26 05:37:57.467601 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 509/1040] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:57 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1604 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:58.151664 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-80a665f9-fd17-4911-bfe6-17de4ab83b25 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:58.152215 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-80a665f9-fd17-4911-bfe6-17de4ab83b25 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:58.159058 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-caeff93e-2d0e-4381-820f-9af5f1f74446 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:58.159487 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-80a665f9-fd17-4911-bfe6-17de4ab83b25 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:58.159832 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-caeff93e-2d0e-4381-820f-9af5f1f74446 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:58.159988 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-80a665f9-fd17-4911-bfe6-17de4ab83b25 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:58.160352 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-80a665f9-fd17-4911-bfe6-17de4ab83b25 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:58.161049 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-80a665f9-fd17-4911-bfe6-17de4ab83b25 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:58.161510 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-80a665f9-fd17-4911-bfe6-17de4ab83b25 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:58.161939 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-80a665f9-fd17-4911-bfe6-17de4ab83b25 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:58.166496 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-caeff93e-2d0e-4381-820f-9af5f1f74446 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:58.166983 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-caeff93e-2d0e-4381-820f-9af5f1f74446 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:58.167415 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-caeff93e-2d0e-4381-820f-9af5f1f74446 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:58.168105 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-caeff93e-2d0e-4381-820f-9af5f1f74446 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:58.168583 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-caeff93e-2d0e-4381-820f-9af5f1f74446 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:58.169048 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-caeff93e-2d0e-4381-820f-9af5f1f74446 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:58.356650 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-caeff93e-2d0e-4381-820f-9af5f1f74446 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:58.364552 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-caeff93e-2d0e-4381-820f-9af5f1f74446 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.209192 Sep 26 05:37:58.365473 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-80a665f9-fd17-4911-bfe6-17de4ab83b25 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:58.373091 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 510/1041] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:58 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:58.374160 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-80a665f9-fd17-4911-bfe6-17de4ab83b25 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.226393 Sep 26 05:37:58.374841 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 532/1042] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:58 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:58.491302 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4ccbb8f7-47e6-471f-9e6b-65882dbfcacb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:58.491915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4ccbb8f7-47e6-471f-9e6b-65882dbfcacb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:58.498451 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4ccbb8f7-47e6-471f-9e6b-65882dbfcacb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:58.498933 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4ccbb8f7-47e6-471f-9e6b-65882dbfcacb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:58.499373 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4ccbb8f7-47e6-471f-9e6b-65882dbfcacb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:58.500050 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4ccbb8f7-47e6-471f-9e6b-65882dbfcacb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:58.500601 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4ccbb8f7-47e6-471f-9e6b-65882dbfcacb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:58.501023 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4ccbb8f7-47e6-471f-9e6b-65882dbfcacb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:58.571536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4ccbb8f7-47e6-471f-9e6b-65882dbfcacb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:58.580094 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4ccbb8f7-47e6-471f-9e6b-65882dbfcacb tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1322 microversion: 2.1 time: 0.092768 Sep 26 05:37:58.580668 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 511/1043] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:58 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1322 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:59.388616 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a732eb70-e07f-471d-8425-86b418c88de9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:59.389191 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a732eb70-e07f-471d-8425-86b418c88de9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:59.395725 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a732eb70-e07f-471d-8425-86b418c88de9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:59.396217 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a732eb70-e07f-471d-8425-86b418c88de9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:59.396716 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a732eb70-e07f-471d-8425-86b418c88de9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:59.397260 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-67e17e28-703a-47cb-9e2a-d4df2fabded2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:59.397670 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a732eb70-e07f-471d-8425-86b418c88de9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:59.397849 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a732eb70-e07f-471d-8425-86b418c88de9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:59.397950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-67e17e28-703a-47cb-9e2a-d4df2fabded2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:59.398286 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a732eb70-e07f-471d-8425-86b418c88de9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:59.404907 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-67e17e28-703a-47cb-9e2a-d4df2fabded2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:59.405392 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-67e17e28-703a-47cb-9e2a-d4df2fabded2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:59.405831 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-67e17e28-703a-47cb-9e2a-d4df2fabded2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:59.406519 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-67e17e28-703a-47cb-9e2a-d4df2fabded2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:59.406973 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-67e17e28-703a-47cb-9e2a-d4df2fabded2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:59.407398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-67e17e28-703a-47cb-9e2a-d4df2fabded2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:59.588688 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a732eb70-e07f-471d-8425-86b418c88de9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:59.593737 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-67e17e28-703a-47cb-9e2a-d4df2fabded2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:59.597598 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:59.597824 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a732eb70-e07f-471d-8425-86b418c88de9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.213376 Sep 26 05:37:59.598612 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 533/1044] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:59 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:59.602792 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-67e17e28-703a-47cb-9e2a-d4df2fabded2 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1266 microversion: 2.1 time: 0.209295 Sep 26 05:37:59.603267 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3af1178b-6c3f-4058-96f6-2a7baef661b3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:59.603881 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-3af1178b-6c3f-4058-96f6-2a7baef661b3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:37:59.610083 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3af1178b-6c3f-4058-96f6-2a7baef661b3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:59.610573 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3af1178b-6c3f-4058-96f6-2a7baef661b3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:59.611016 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3af1178b-6c3f-4058-96f6-2a7baef661b3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:59.611711 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3af1178b-6c3f-4058-96f6-2a7baef661b3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:37:59.612169 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3af1178b-6c3f-4058-96f6-2a7baef661b3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:37:59.612529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 512/1045] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:59 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:59.612731 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3af1178b-6c3f-4058-96f6-2a7baef661b3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:37:59.680367 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-3af1178b-6c3f-4058-96f6-2a7baef661b3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:37:59.688812 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-3af1178b-6c3f-4058-96f6-2a7baef661b3 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1322 microversion: 2.1 time: 0.089113 Sep 26 05:37:59.689382 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 534/1046] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:37:59 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1322 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:00.620149 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7d540f60-ec93-4411-bca9-5d8c05e24169 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:00.620797 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7d540f60-ec93-4411-bca9-5d8c05e24169 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:00.626973 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6859600c-7ddc-47ea-ac46-5d186d7c9bba tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:00.627597 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6859600c-7ddc-47ea-ac46-5d186d7c9bba tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:00.628190 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d540f60-ec93-4411-bca9-5d8c05e24169 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:00.628699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d540f60-ec93-4411-bca9-5d8c05e24169 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:00.629133 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d540f60-ec93-4411-bca9-5d8c05e24169 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:00.629825 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d540f60-ec93-4411-bca9-5d8c05e24169 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:00.630272 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d540f60-ec93-4411-bca9-5d8c05e24169 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:00.630695 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7d540f60-ec93-4411-bca9-5d8c05e24169 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:00.634062 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6859600c-7ddc-47ea-ac46-5d186d7c9bba tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:00.634578 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6859600c-7ddc-47ea-ac46-5d186d7c9bba tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:00.635035 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6859600c-7ddc-47ea-ac46-5d186d7c9bba tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:00.635758 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6859600c-7ddc-47ea-ac46-5d186d7c9bba tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:00.636215 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6859600c-7ddc-47ea-ac46-5d186d7c9bba tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:00.636672 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6859600c-7ddc-47ea-ac46-5d186d7c9bba tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:00.820854 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6859600c-7ddc-47ea-ac46-5d186d7c9bba tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:00.824728 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7d540f60-ec93-4411-bca9-5d8c05e24169 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:00.829754 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6859600c-7ddc-47ea-ac46-5d186d7c9bba tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1453 microversion: 2.1 time: 0.207402 Sep 26 05:38:00.830326 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 535/1047] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:00 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1453 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:38:00.833074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7d540f60-ec93-4411-bca9-5d8c05e24169 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.216742 Sep 26 05:38:00.833802 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 513/1048] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:00 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:00.834889 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-2fd3b410-6b5b-4dec-8b7d-ac948b8b4dec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:00.835515 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-2fd3b410-6b5b-4dec-8b7d-ac948b8b4dec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:00.841202 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2fd3b410-6b5b-4dec-8b7d-ac948b8b4dec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:00.841738 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2fd3b410-6b5b-4dec-8b7d-ac948b8b4dec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:00.842180 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2fd3b410-6b5b-4dec-8b7d-ac948b8b4dec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:00.842931 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2fd3b410-6b5b-4dec-8b7d-ac948b8b4dec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:00.843391 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2fd3b410-6b5b-4dec-8b7d-ac948b8b4dec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:00.843817 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2fd3b410-6b5b-4dec-8b7d-ac948b8b4dec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:00.852786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f523cae6-b67b-4bd0-a8af-d0519a06dee5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:00.853398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f523cae6-b67b-4bd0-a8af-d0519a06dee5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:00.859211 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f523cae6-b67b-4bd0-a8af-d0519a06dee5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:00.859693 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f523cae6-b67b-4bd0-a8af-d0519a06dee5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:00.860125 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f523cae6-b67b-4bd0-a8af-d0519a06dee5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:00.860834 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f523cae6-b67b-4bd0-a8af-d0519a06dee5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:00.861283 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f523cae6-b67b-4bd0-a8af-d0519a06dee5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:00.861702 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f523cae6-b67b-4bd0-a8af-d0519a06dee5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:00.875341 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2fd3b410-6b5b-4dec-8b7d-ac948b8b4dec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:00.875746 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2fd3b410-6b5b-4dec-8b7d-ac948b8b4dec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:00.876179 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2fd3b410-6b5b-4dec-8b7d-ac948b8b4dec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:00.876643 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-2fd3b410-6b5b-4dec-8b7d-ac948b8b4dec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lazy-loading 'fault' on Instance uuid 69ae32da-8cf7-4b65-9387-3d013453dbe5 {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:38:00.919100 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2fd3b410-6b5b-4dec-8b7d-ac948b8b4dec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:00.922571 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=100 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:00.927576 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2fd3b410-6b5b-4dec-8b7d-ac948b8b4dec tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1327 microversion: 2.1 time: 0.096270 Sep 26 05:38:00.928156 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 536/1049] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:00 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:01.015051 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f523cae6-b67b-4bd0-a8af-d0519a06dee5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:01.022755 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f523cae6-b67b-4bd0-a8af-d0519a06dee5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1453 microversion: 2.1 time: 0.173671 Sep 26 05:38:01.023317 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 514/1050] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:00 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:01.856087 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c27e7145-0963-4d97-8075-df30673cf39b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:01.856768 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c27e7145-0963-4d97-8075-df30673cf39b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:01.863409 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c27e7145-0963-4d97-8075-df30673cf39b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:01.863903 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c27e7145-0963-4d97-8075-df30673cf39b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:01.864372 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c27e7145-0963-4d97-8075-df30673cf39b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:01.865203 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c27e7145-0963-4d97-8075-df30673cf39b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:01.865680 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c27e7145-0963-4d97-8075-df30673cf39b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:01.866169 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c27e7145-0963-4d97-8075-df30673cf39b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:01.953347 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-66771c3c-0678-4dde-b0d2-48f2821508d7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:01.954367 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-66771c3c-0678-4dde-b0d2-48f2821508d7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:01.961011 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66771c3c-0678-4dde-b0d2-48f2821508d7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:01.961537 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66771c3c-0678-4dde-b0d2-48f2821508d7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:01.961978 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66771c3c-0678-4dde-b0d2-48f2821508d7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:01.962769 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66771c3c-0678-4dde-b0d2-48f2821508d7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:01.963335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66771c3c-0678-4dde-b0d2-48f2821508d7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:01.963963 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66771c3c-0678-4dde-b0d2-48f2821508d7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:01.997578 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66771c3c-0678-4dde-b0d2-48f2821508d7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:01.998071 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66771c3c-0678-4dde-b0d2-48f2821508d7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:01.998510 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66771c3c-0678-4dde-b0d2-48f2821508d7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:01.998959 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-66771c3c-0678-4dde-b0d2-48f2821508d7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lazy-loading 'fault' on Instance uuid 69ae32da-8cf7-4b65-9387-3d013453dbe5 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:38:02.082629 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-66771c3c-0678-4dde-b0d2-48f2821508d7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:02.092228 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-66771c3c-0678-4dde-b0d2-48f2821508d7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1327 microversion: 2.1 time: 0.143563 Sep 26 05:38:02.092978 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 515/1051] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:01 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1327 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:02.116331 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-c27e7145-0963-4d97-8075-df30673cf39b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:02.124340 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c27e7145-0963-4d97-8075-df30673cf39b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.272028 Sep 26 05:38:02.124901 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 537/1052] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:01 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:38:02.928147 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-1bce734b-1678-4d5e-8fe8-87202b99bac9 req-e1b1fa3e-7ae7-4c83-b3f7-20acf835a1ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6a2248-68b0-4336-ade5-c6c3b756cdae", "tag": "e47ebac1-d877-4ac1-8e2f-fb371cb2f895"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:38:02.938174 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-1bce734b-1678-4d5e-8fe8-87202b99bac9 req-e1b1fa3e-7ae7-4c83-b3f7-20acf835a1ad service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:02.938647 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-1bce734b-1678-4d5e-8fe8-87202b99bac9 req-e1b1fa3e-7ae7-4c83-b3f7-20acf835a1ad service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:02.939085 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-1bce734b-1678-4d5e-8fe8-87202b99bac9 req-e1b1fa3e-7ae7-4c83-b3f7-20acf835a1ad service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:02.951202 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-1bce734b-1678-4d5e-8fe8-87202b99bac9 req-e1b1fa3e-7ae7-4c83-b3f7-20acf835a1ad service nova] Creating event network-changed:e47ebac1-d877-4ac1-8e2f-fb371cb2f895 for instance 1e6a2248-68b0-4336-ade5-c6c3b756cdae on hv-cinder-85918 Sep 26 05:38:02.956915 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-1bce734b-1678-4d5e-8fe8-87202b99bac9 req-e1b1fa3e-7ae7-4c83-b3f7-20acf835a1ad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032395 Sep 26 05:38:02.957839 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 516/1053] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:38:03.115787 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-0c010884-693a-4a71-bed5-01ed645d2146 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:03.116511 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-0c010884-693a-4a71-bed5-01ed645d2146 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:03.124003 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c010884-693a-4a71-bed5-01ed645d2146 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:03.124543 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c010884-693a-4a71-bed5-01ed645d2146 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:03.124980 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c010884-693a-4a71-bed5-01ed645d2146 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:03.125678 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c010884-693a-4a71-bed5-01ed645d2146 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:03.126129 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c010884-693a-4a71-bed5-01ed645d2146 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:03.126551 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c010884-693a-4a71-bed5-01ed645d2146 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:03.149708 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-74c3deea-751d-4b44-a0e9-99b957ce86a4 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:03.150755 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-74c3deea-751d-4b44-a0e9-99b957ce86a4 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:03.157917 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74c3deea-751d-4b44-a0e9-99b957ce86a4 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:03.158693 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74c3deea-751d-4b44-a0e9-99b957ce86a4 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:03.159298 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74c3deea-751d-4b44-a0e9-99b957ce86a4 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:03.160188 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74c3deea-751d-4b44-a0e9-99b957ce86a4 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:03.160672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74c3deea-751d-4b44-a0e9-99b957ce86a4 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:03.161287 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74c3deea-751d-4b44-a0e9-99b957ce86a4 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:03.162687 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c010884-693a-4a71-bed5-01ed645d2146 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:03.163167 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c010884-693a-4a71-bed5-01ed645d2146 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:03.163605 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c010884-693a-4a71-bed5-01ed645d2146 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:03.164057 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-0c010884-693a-4a71-bed5-01ed645d2146 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lazy-loading 'fault' on Instance uuid 69ae32da-8cf7-4b65-9387-3d013453dbe5 {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:38:03.223253 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0c010884-693a-4a71-bed5-01ed645d2146 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:03.230914 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-0c010884-693a-4a71-bed5-01ed645d2146 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1327 microversion: 2.1 time: 0.119751 Sep 26 05:38:03.231486 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 538/1054] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:03 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:03.331878 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-74c3deea-751d-4b44-a0e9-99b957ce86a4 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:03.340311 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-74c3deea-751d-4b44-a0e9-99b957ce86a4 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.196521 Sep 26 05:38:03.345919 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 517/1055] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:03 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:04.254919 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9a3dddc7-10bd-4452-a349-e656a43e5e8f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:04.255474 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-9a3dddc7-10bd-4452-a349-e656a43e5e8f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:04.262030 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9a3dddc7-10bd-4452-a349-e656a43e5e8f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:04.262511 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9a3dddc7-10bd-4452-a349-e656a43e5e8f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:04.262991 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9a3dddc7-10bd-4452-a349-e656a43e5e8f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:04.263861 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9a3dddc7-10bd-4452-a349-e656a43e5e8f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:04.264345 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9a3dddc7-10bd-4452-a349-e656a43e5e8f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:04.265236 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9a3dddc7-10bd-4452-a349-e656a43e5e8f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:04.295170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9a3dddc7-10bd-4452-a349-e656a43e5e8f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:04.295656 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9a3dddc7-10bd-4452-a349-e656a43e5e8f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:04.296095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9a3dddc7-10bd-4452-a349-e656a43e5e8f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:04.296571 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-9a3dddc7-10bd-4452-a349-e656a43e5e8f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lazy-loading 'fault' on Instance uuid 69ae32da-8cf7-4b65-9387-3d013453dbe5 {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:38:04.339001 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-9a3dddc7-10bd-4452-a349-e656a43e5e8f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ccb163613a40ac8042f229199717f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe69e57e744eea93988aecfa9decc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:04.348403 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-9a3dddc7-10bd-4452-a349-e656a43e5e8f tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 200 len: 1327 microversion: 2.1 time: 0.097345 Sep 26 05:38:04.348975 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 539/1056] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:04 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:04.364009 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a9ad4a3f-9d45-4f7a-8e92-5d76ddb784b5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:04.364614 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a9ad4a3f-9d45-4f7a-8e92-5d76ddb784b5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:04.370601 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a9ad4a3f-9d45-4f7a-8e92-5d76ddb784b5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:04.371062 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a9ad4a3f-9d45-4f7a-8e92-5d76ddb784b5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:04.371699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a9ad4a3f-9d45-4f7a-8e92-5d76ddb784b5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:04.372543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a9ad4a3f-9d45-4f7a-8e92-5d76ddb784b5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:04.373068 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a9ad4a3f-9d45-4f7a-8e92-5d76ddb784b5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:04.373485 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a9ad4a3f-9d45-4f7a-8e92-5d76ddb784b5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:04.518295 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a9ad4a3f-9d45-4f7a-8e92-5d76ddb784b5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:04.529219 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a9ad4a3f-9d45-4f7a-8e92-5d76ddb784b5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.168255 Sep 26 05:38:04.529821 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 518/1057] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:04 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:05.371238 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9b680c49-01e3-461f-add4-d62d6cb4c428 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:05.371770 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-9b680c49-01e3-461f-add4-d62d6cb4c428 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:05.378428 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9b680c49-01e3-461f-add4-d62d6cb4c428 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:05.378914 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9b680c49-01e3-461f-add4-d62d6cb4c428 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:05.379349 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9b680c49-01e3-461f-add4-d62d6cb4c428 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:05.380036 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9b680c49-01e3-461f-add4-d62d6cb4c428 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:05.380541 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9b680c49-01e3-461f-add4-d62d6cb4c428 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:05.380973 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9b680c49-01e3-461f-add4-d62d6cb4c428 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:05.394899 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-9b680c49-01e3-461f-add4-d62d6cb4c428 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] HTTP exception thrown: Instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 could not be found. Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9b680c49-01e3-461f-add4-d62d6cb4c428 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Request method failure captured: Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 HTTP/1.1 Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTkReKLe6I7Hw9o7xQNJ90qh6MG2KreFJbp_Iam3kZtx0-WRsoTrmAli0yXytCDoRWiSs8pBAv-XpwPaEBOpwEpunytNr5KFIP8u_hso_HCqNwk1sSPVnpJkCRVSRQ7fKYGccIGT2A_vi_JM_Gt7MDB6v9F9dZprqhCM9Wa72r_wZgA Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: 49fe69e57e744eea93988aecfa9decc2 Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-AttachVolumeTestJSON-868830527 Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:38:05.396598 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:38:05.398309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49fe69e57e744eea93988aecfa9decc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49fe69e57e744eea93988aecfa9decc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49fe69e57e744eea93988aecfa9decc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49fe69e57e744eea93988aecfa9decc2"}]}] Sep 26 05:38:05.398309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-AttachVolumeTestJSON-868830527 Sep 26 05:38:05.398309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: 49fe69e57e744eea93988aecfa9decc2 Sep 26 05:38:05.398309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-AttachVolumeTestJSON-868830527 Sep 26 05:38:05.398309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-AttachVolumeTestJSON-868830527-project Sep 26 05:38:05.398309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:38:05.398309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:38:05.398309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 30ccb163613a40ac8042f229199717f6 Sep 26 05:38:05.398309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-AttachVolumeTestJSON-868830527-project Sep 26 05:38:05.398309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:38:05.398309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 could not be found. Sep 26 05:38:05.398309 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': '69ae32da-8cf7-4b65-9387-3d013453dbe5'} Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 could not be found. Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:38:05.399214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:38:05.400876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:38:05.400876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:38:05.400876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:38:05.400876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:38:05.400876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:38:05.400876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:38:05.400876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:38:05.400876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 could not be found. Sep 26 05:38:05.400876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:38:05.400876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:38:05.400876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:38:05.400876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:38:05.400876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:38:05.400876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:38:05.400876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:38:05.400876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:38:05.400876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 could not be found. Sep 26 05:38:05.400876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:38:05.402335 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9b680c49-01e3-461f-add4-d62d6cb4c428 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Returning 404 to user: Instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:38:05.402335 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-9b680c49-01e3-461f-add4-d62d6cb4c428 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 404 len: 111 microversion: 2.1 time: 0.030969 Sep 26 05:38:05.402335 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 540/1058] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:05 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:38:05.406731 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b6aba87a-867d-40d0-b40f-4d39dd12db68 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '.version_select at 0x7fd7b7167a60>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:05.426553 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b6aba87a-867d-40d0-b40f-4d39dd12db68 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-145463540" status: 202 len: 0 microversion: 2.1 time: 0.023512 Sep 26 05:38:05.427132 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 519/1059] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Sep 26 05:38:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-145463540 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:38:05.554278 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-27559bf5-55ed-4469-8490-ffb0ec68d109 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:05.554789 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-27559bf5-55ed-4469-8490-ffb0ec68d109 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:05.561662 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-27559bf5-55ed-4469-8490-ffb0ec68d109 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:05.562154 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-27559bf5-55ed-4469-8490-ffb0ec68d109 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:05.562648 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-27559bf5-55ed-4469-8490-ffb0ec68d109 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:05.563399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-27559bf5-55ed-4469-8490-ffb0ec68d109 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:05.563909 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-27559bf5-55ed-4469-8490-ffb0ec68d109 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:05.564437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-27559bf5-55ed-4469-8490-ffb0ec68d109 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:05.856875 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-27559bf5-55ed-4469-8490-ffb0ec68d109 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:05.864987 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-27559bf5-55ed-4469-8490-ffb0ec68d109 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.314943 Sep 26 05:38:05.865553 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 541/1060] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:05 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:06.892386 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bf1ca930-fbeb-4392-bdf6-4f17b9d690ec tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:06.893081 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bf1ca930-fbeb-4392-bdf6-4f17b9d690ec tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:06.905748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bf1ca930-fbeb-4392-bdf6-4f17b9d690ec tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:06.907122 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bf1ca930-fbeb-4392-bdf6-4f17b9d690ec tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:06.907550 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bf1ca930-fbeb-4392-bdf6-4f17b9d690ec tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:06.908635 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bf1ca930-fbeb-4392-bdf6-4f17b9d690ec tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:06.910356 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bf1ca930-fbeb-4392-bdf6-4f17b9d690ec tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:06.911342 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bf1ca930-fbeb-4392-bdf6-4f17b9d690ec tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:07.089073 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bf1ca930-fbeb-4392-bdf6-4f17b9d690ec tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:07.098531 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bf1ca930-fbeb-4392-bdf6-4f17b9d690ec tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.212004 Sep 26 05:38:07.100975 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 520/1061] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:06 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:08.124605 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6a59d767-2d22-4221-8dfc-166b6540e5ab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:08.125218 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6a59d767-2d22-4221-8dfc-166b6540e5ab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:08.131684 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6a59d767-2d22-4221-8dfc-166b6540e5ab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:08.132167 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6a59d767-2d22-4221-8dfc-166b6540e5ab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:08.132650 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6a59d767-2d22-4221-8dfc-166b6540e5ab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:08.133315 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6a59d767-2d22-4221-8dfc-166b6540e5ab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:08.133765 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6a59d767-2d22-4221-8dfc-166b6540e5ab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:08.134183 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6a59d767-2d22-4221-8dfc-166b6540e5ab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:08.276227 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6a59d767-2d22-4221-8dfc-166b6540e5ab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:08.285397 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6a59d767-2d22-4221-8dfc-166b6540e5ab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.165358 Sep 26 05:38:08.285968 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 542/1062] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:08 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:09.311028 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8601f5ed-7364-4e00-8b48-4e1be5ac6351 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:09.311888 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8601f5ed-7364-4e00-8b48-4e1be5ac6351 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:09.319504 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8601f5ed-7364-4e00-8b48-4e1be5ac6351 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:09.320163 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8601f5ed-7364-4e00-8b48-4e1be5ac6351 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:09.320642 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8601f5ed-7364-4e00-8b48-4e1be5ac6351 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:09.321374 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8601f5ed-7364-4e00-8b48-4e1be5ac6351 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:09.321823 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8601f5ed-7364-4e00-8b48-4e1be5ac6351 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:09.322452 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8601f5ed-7364-4e00-8b48-4e1be5ac6351 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:09.461550 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8601f5ed-7364-4e00-8b48-4e1be5ac6351 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:09.469892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8601f5ed-7364-4e00-8b48-4e1be5ac6351 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.162889 Sep 26 05:38:09.470463 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 521/1063] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:09 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:10.493253 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-edb3e115-537f-44b5-8c06-9135f83ab7d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:10.493980 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-edb3e115-537f-44b5-8c06-9135f83ab7d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:10.501252 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-edb3e115-537f-44b5-8c06-9135f83ab7d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:10.501751 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-edb3e115-537f-44b5-8c06-9135f83ab7d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:10.502188 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-edb3e115-537f-44b5-8c06-9135f83ab7d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:10.502890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-edb3e115-537f-44b5-8c06-9135f83ab7d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:10.503350 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-edb3e115-537f-44b5-8c06-9135f83ab7d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:10.503780 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-edb3e115-537f-44b5-8c06-9135f83ab7d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:10.673610 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-edb3e115-537f-44b5-8c06-9135f83ab7d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:10.681978 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-edb3e115-537f-44b5-8c06-9135f83ab7d2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.192762 Sep 26 05:38:10.682775 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 543/1064] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:10 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:10.843107 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-fa889868-8203-4e32-8455-dd7616e45d94 req-9fe0b8cb-967a-4ffc-b70b-4ca4a6e74316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2df85633-fcf8-4640-bfac-ffc0f55778ac", "name": "network-vif-plugged", "status": "completed", "tag": "3211bad3-a3ee-47c8-a87f-240818a7928b"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:38:10.857671 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-fa889868-8203-4e32-8455-dd7616e45d94 req-9fe0b8cb-967a-4ffc-b70b-4ca4a6e74316 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:10.858206 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-fa889868-8203-4e32-8455-dd7616e45d94 req-9fe0b8cb-967a-4ffc-b70b-4ca4a6e74316 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:10.858639 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-fa889868-8203-4e32-8455-dd7616e45d94 req-9fe0b8cb-967a-4ffc-b70b-4ca4a6e74316 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:10.873107 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-fa889868-8203-4e32-8455-dd7616e45d94 req-9fe0b8cb-967a-4ffc-b70b-4ca4a6e74316 service nova] Creating event network-vif-plugged:3211bad3-a3ee-47c8-a87f-240818a7928b for instance 2df85633-fcf8-4640-bfac-ffc0f55778ac on hv-cinder-85918 Sep 26 05:38:10.878873 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-fa889868-8203-4e32-8455-dd7616e45d94 req-9fe0b8cb-967a-4ffc-b70b-4ca4a6e74316 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039984 Sep 26 05:38:10.879759 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 522/1065] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:38:11.629918 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-cfb924e4-5ec8-4cc8-9ecb-7b193b6c4c58 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:11.630522 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-cfb924e4-5ec8-4cc8-9ecb-7b193b6c4c58 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:11.638064 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cfb924e4-5ec8-4cc8-9ecb-7b193b6c4c58 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:11.639112 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cfb924e4-5ec8-4cc8-9ecb-7b193b6c4c58 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:11.639631 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cfb924e4-5ec8-4cc8-9ecb-7b193b6c4c58 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:11.640508 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cfb924e4-5ec8-4cc8-9ecb-7b193b6c4c58 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:11.641376 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cfb924e4-5ec8-4cc8-9ecb-7b193b6c4c58 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:11.642124 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cfb924e4-5ec8-4cc8-9ecb-7b193b6c4c58 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:11.657867 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-cfb924e4-5ec8-4cc8-9ecb-7b193b6c4c58 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] HTTP exception thrown: Instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 could not be found. Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-cfb924e4-5ec8-4cc8-9ecb-7b193b6c4c58 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Request method failure captured: Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: DELETE /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 HTTP/1.1 Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTkReKLe6I7Hw9o7xQNJ90qh6MG2KreFJbp_Iam3kZtx0-WRsoTrmAli0yXytCDoRWiSs8pBAv-XpwPaEBOpwEpunytNr5KFIP8u_hso_HCqNwk1sSPVnpJkCRVSRQ7fKYGccIGT2A_vi_JM_Gt7MDB6v9F9dZprqhCM9Wa72r_wZgA Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: 49fe69e57e744eea93988aecfa9decc2 Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-AttachVolumeTestJSON-868830527 Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:38:11.659465 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:38:11.661224 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49fe69e57e744eea93988aecfa9decc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49fe69e57e744eea93988aecfa9decc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49fe69e57e744eea93988aecfa9decc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49fe69e57e744eea93988aecfa9decc2"}]}] Sep 26 05:38:11.661224 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-AttachVolumeTestJSON-868830527 Sep 26 05:38:11.661224 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: 49fe69e57e744eea93988aecfa9decc2 Sep 26 05:38:11.661224 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-AttachVolumeTestJSON-868830527 Sep 26 05:38:11.661224 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-AttachVolumeTestJSON-868830527-project Sep 26 05:38:11.661224 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:38:11.661224 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:38:11.661224 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 30ccb163613a40ac8042f229199717f6 Sep 26 05:38:11.661224 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-AttachVolumeTestJSON-868830527-project Sep 26 05:38:11.661224 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:38:11.661224 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 could not be found. Sep 26 05:38:11.661224 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': '69ae32da-8cf7-4b65-9387-3d013453dbe5'} Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 could not be found. Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:38:11.662220 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 could not be found. Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 could not be found. Sep 26 05:38:11.663658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:38:11.665265 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-cfb924e4-5ec8-4cc8-9ecb-7b193b6c4c58 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Returning 404 to user: Instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:38:11.665265 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-cfb924e4-5ec8-4cc8-9ecb-7b193b6c4c58 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "DELETE /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 404 len: 111 microversion: 2.1 time: 0.035080 Sep 26 05:38:11.665265 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 544/1066] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:38:11 2022] DELETE /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:38:11.675063 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ed829a5b-7b67-4db7-afd3-676ec018cdea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:11.676174 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ed829a5b-7b67-4db7-afd3-676ec018cdea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: 69ae32da-8cf7-4b65-9387-3d013453dbe5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:11.684135 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ed829a5b-7b67-4db7-afd3-676ec018cdea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:11.686334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ed829a5b-7b67-4db7-afd3-676ec018cdea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:11.686334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ed829a5b-7b67-4db7-afd3-676ec018cdea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:11.686334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ed829a5b-7b67-4db7-afd3-676ec018cdea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:11.686334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ed829a5b-7b67-4db7-afd3-676ec018cdea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:11.686769 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ed829a5b-7b67-4db7-afd3-676ec018cdea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:11.701626 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-ed829a5b-7b67-4db7-afd3-676ec018cdea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] HTTP exception thrown: Instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 could not be found. Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ed829a5b-7b67-4db7-afd3-676ec018cdea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Request method failure captured: Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 HTTP/1.1 Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTkReKLe6I7Hw9o7xQNJ90qh6MG2KreFJbp_Iam3kZtx0-WRsoTrmAli0yXytCDoRWiSs8pBAv-XpwPaEBOpwEpunytNr5KFIP8u_hso_HCqNwk1sSPVnpJkCRVSRQ7fKYGccIGT2A_vi_JM_Gt7MDB6v9F9dZprqhCM9Wa72r_wZgA Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: 49fe69e57e744eea93988aecfa9decc2 Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeTestJSON-868830527 Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:38:11.703363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:38:11.705093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49fe69e57e744eea93988aecfa9decc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49fe69e57e744eea93988aecfa9decc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49fe69e57e744eea93988aecfa9decc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49fe69e57e744eea93988aecfa9decc2"}]}] Sep 26 05:38:11.705093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeTestJSON-868830527 Sep 26 05:38:11.705093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 49fe69e57e744eea93988aecfa9decc2 Sep 26 05:38:11.705093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeTestJSON-868830527 Sep 26 05:38:11.705093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeTestJSON-868830527-project Sep 26 05:38:11.705093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:38:11.705093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:38:11.705093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 30ccb163613a40ac8042f229199717f6 Sep 26 05:38:11.705093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeTestJSON-868830527-project Sep 26 05:38:11.705093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:38:11.705093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 could not be found. Sep 26 05:38:11.705093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': '69ae32da-8cf7-4b65-9387-3d013453dbe5'} Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 could not be found. Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:38:11.709176 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:38:11.711033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:38:11.711033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:38:11.711033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:38:11.711033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:38:11.711033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:38:11.711033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:38:11.711033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:38:11.711033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 could not be found. Sep 26 05:38:11.711033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:11.711033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:38:11.711033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:11.711033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:38:11.711033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:38:11.711033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:38:11.711033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:38:11.711033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:38:11.711033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 could not be found. Sep 26 05:38:11.711033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:11.712631 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ed829a5b-7b67-4db7-afd3-676ec018cdea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Returning 404 to user: Instance 69ae32da-8cf7-4b65-9387-3d013453dbe5 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:38:11.712631 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ed829a5b-7b67-4db7-afd3-676ec018cdea tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5" status: 404 len: 111 microversion: 2.1 time: 0.034580 Sep 26 05:38:11.712631 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 523/1067] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:11 2022] GET /compute/v2.1/servers/69ae32da-8cf7-4b65-9387-3d013453dbe5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:38:11.717475 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-29aa3c62-461d-4ce5-99b6-f98186ea5ea0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:11.718301 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-29aa3c62-461d-4ce5-99b6-f98186ea5ea0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:11.724815 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-29aa3c62-461d-4ce5-99b6-f98186ea5ea0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:11.725349 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-29aa3c62-461d-4ce5-99b6-f98186ea5ea0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:11.725849 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-29aa3c62-461d-4ce5-99b6-f98186ea5ea0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:11.726603 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-29aa3c62-461d-4ce5-99b6-f98186ea5ea0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:11.727089 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-29aa3c62-461d-4ce5-99b6-f98186ea5ea0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:11.727527 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-29aa3c62-461d-4ce5-99b6-f98186ea5ea0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:11.879262 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-29aa3c62-461d-4ce5-99b6-f98186ea5ea0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:11.888972 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-29aa3c62-461d-4ce5-99b6-f98186ea5ea0 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1358 microversion: 2.1 time: 0.185715 Sep 26 05:38:11.890023 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 545/1068] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:11 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:12.879699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ad822dc6-511f-4e3a-b07b-7bdd32356fd7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:12.880224 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ad822dc6-511f-4e3a-b07b-7bdd32356fd7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:12.882720 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:12.889087 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ad822dc6-511f-4e3a-b07b-7bdd32356fd7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:12.889580 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ad822dc6-511f-4e3a-b07b-7bdd32356fd7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:12.890151 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ad822dc6-511f-4e3a-b07b-7bdd32356fd7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:12.890878 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ad822dc6-511f-4e3a-b07b-7bdd32356fd7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:12.891335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ad822dc6-511f-4e3a-b07b-7bdd32356fd7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:12.891764 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ad822dc6-511f-4e3a-b07b-7bdd32356fd7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:12.908062 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-ad822dc6-511f-4e3a-b07b-7bdd32356fd7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] HTTP exception thrown: Instance de4a6090-4a17-4d48-806a-1fbfb8556e47 could not be found. Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ad822dc6-511f-4e3a-b07b-7bdd32356fd7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Request method failure captured: Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: DELETE /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 HTTP/1.1 Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTkReKLe6I7Hw9o7xQNJ90qh6MG2KreFJbp_Iam3kZtx0-WRsoTrmAli0yXytCDoRWiSs8pBAv-XpwPaEBOpwEpunytNr5KFIP8u_hso_HCqNwk1sSPVnpJkCRVSRQ7fKYGccIGT2A_vi_JM_Gt7MDB6v9F9dZprqhCM9Wa72r_wZgA Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: 49fe69e57e744eea93988aecfa9decc2 Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeTestJSON-868830527 Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:38:12.910179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:38:12.911583 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49fe69e57e744eea93988aecfa9decc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49fe69e57e744eea93988aecfa9decc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49fe69e57e744eea93988aecfa9decc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49fe69e57e744eea93988aecfa9decc2"}]}] Sep 26 05:38:12.911583 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeTestJSON-868830527 Sep 26 05:38:12.911583 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 49fe69e57e744eea93988aecfa9decc2 Sep 26 05:38:12.911583 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeTestJSON-868830527 Sep 26 05:38:12.911583 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeTestJSON-868830527-project Sep 26 05:38:12.911583 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:38:12.911583 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:38:12.911583 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 30ccb163613a40ac8042f229199717f6 Sep 26 05:38:12.911583 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeTestJSON-868830527-project Sep 26 05:38:12.911583 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:38:12.911583 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance de4a6090-4a17-4d48-806a-1fbfb8556e47 could not be found. Sep 26 05:38:12.911583 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': 'de4a6090-4a17-4d48-806a-1fbfb8556e47'} Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de4a6090-4a17-4d48-806a-1fbfb8556e47 could not be found. Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:38:12.912493 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de4a6090-4a17-4d48-806a-1fbfb8556e47 could not be found. Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de4a6090-4a17-4d48-806a-1fbfb8556e47 could not be found. Sep 26 05:38:12.914069 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:12.915753 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ad822dc6-511f-4e3a-b07b-7bdd32356fd7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Returning 404 to user: Instance de4a6090-4a17-4d48-806a-1fbfb8556e47 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:38:12.915753 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ad822dc6-511f-4e3a-b07b-7bdd32356fd7 tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "DELETE /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 404 len: 111 microversion: 2.1 time: 0.036018 Sep 26 05:38:12.915923 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-87bac906-2a5f-4edc-86c9-42e5e09d19fb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:12.916390 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 524/1069] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:38:12 2022] DELETE /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:38:12.916519 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-87bac906-2a5f-4edc-86c9-42e5e09d19fb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:12.919420 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=70 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:12.920875 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-87bac906-2a5f-4edc-86c9-42e5e09d19fb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:12.921512 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-87bac906-2a5f-4edc-86c9-42e5e09d19fb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:12.921950 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-87bac906-2a5f-4edc-86c9-42e5e09d19fb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:12.922539 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a055ffa0-914c-4e6f-ab7c-cc7e2c14201c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:12.922867 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-87bac906-2a5f-4edc-86c9-42e5e09d19fb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:12.923221 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a055ffa0-914c-4e6f-ab7c-cc7e2c14201c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] [instance: de4a6090-4a17-4d48-806a-1fbfb8556e47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:12.923360 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-87bac906-2a5f-4edc-86c9-42e5e09d19fb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:12.923753 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-87bac906-2a5f-4edc-86c9-42e5e09d19fb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:12.929675 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a055ffa0-914c-4e6f-ab7c-cc7e2c14201c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:12.930163 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a055ffa0-914c-4e6f-ab7c-cc7e2c14201c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:12.930836 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a055ffa0-914c-4e6f-ab7c-cc7e2c14201c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:12.931653 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a055ffa0-914c-4e6f-ab7c-cc7e2c14201c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:12.932239 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a055ffa0-914c-4e6f-ab7c-cc7e2c14201c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:12.932755 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a055ffa0-914c-4e6f-ab7c-cc7e2c14201c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:12.949038 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-a055ffa0-914c-4e6f-ab7c-cc7e2c14201c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] HTTP exception thrown: Instance de4a6090-4a17-4d48-806a-1fbfb8556e47 could not be found. Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a055ffa0-914c-4e6f-ab7c-cc7e2c14201c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Request method failure captured: Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 HTTP/1.1 Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTkReKLe6I7Hw9o7xQNJ90qh6MG2KreFJbp_Iam3kZtx0-WRsoTrmAli0yXytCDoRWiSs8pBAv-XpwPaEBOpwEpunytNr5KFIP8u_hso_HCqNwk1sSPVnpJkCRVSRQ7fKYGccIGT2A_vi_JM_Gt7MDB6v9F9dZprqhCM9Wa72r_wZgA Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: 49fe69e57e744eea93988aecfa9decc2 Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeTestJSON-868830527 Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:38:12.951034 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:38:12.952543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49fe69e57e744eea93988aecfa9decc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49fe69e57e744eea93988aecfa9decc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49fe69e57e744eea93988aecfa9decc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49fe69e57e744eea93988aecfa9decc2"}]}] Sep 26 05:38:12.952543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeTestJSON-868830527 Sep 26 05:38:12.952543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 49fe69e57e744eea93988aecfa9decc2 Sep 26 05:38:12.952543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeTestJSON-868830527 Sep 26 05:38:12.952543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeTestJSON-868830527-project Sep 26 05:38:12.952543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:38:12.952543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:38:12.952543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 30ccb163613a40ac8042f229199717f6 Sep 26 05:38:12.952543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeTestJSON-868830527-project Sep 26 05:38:12.952543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:38:12.952543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance de4a6090-4a17-4d48-806a-1fbfb8556e47 could not be found. Sep 26 05:38:12.952543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': 'de4a6090-4a17-4d48-806a-1fbfb8556e47'} Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de4a6090-4a17-4d48-806a-1fbfb8556e47 could not be found. Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:38:12.953529 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:38:12.955159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:38:12.955159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:38:12.955159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:38:12.955159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:38:12.955159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:38:12.955159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:38:12.955159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:38:12.955159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de4a6090-4a17-4d48-806a-1fbfb8556e47 could not be found. Sep 26 05:38:12.955159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:12.955159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:38:12.955159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:12.955159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:38:12.955159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:38:12.955159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:38:12.955159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:38:12.955159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:38:12.955159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de4a6090-4a17-4d48-806a-1fbfb8556e47 could not be found. Sep 26 05:38:12.955159 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:12.956655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a055ffa0-914c-4e6f-ab7c-cc7e2c14201c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] Returning 404 to user: Instance de4a6090-4a17-4d48-806a-1fbfb8556e47 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:38:12.956655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a055ffa0-914c-4e6f-ab7c-cc7e2c14201c tempest-AttachVolumeTestJSON-868830527 tempest-AttachVolumeTestJSON-868830527-project] 10.222.0.49 "GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47" status: 404 len: 111 microversion: 2.1 time: 0.035238 Sep 26 05:38:12.956655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 525/1070] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:12 2022] GET /compute/v2.1/servers/de4a6090-4a17-4d48-806a-1fbfb8556e47 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:38:13.083444 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-87bac906-2a5f-4edc-86c9-42e5e09d19fb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:13.091590 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-87bac906-2a5f-4edc-86c9-42e5e09d19fb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1548 microversion: 2.1 time: 0.182553 Sep 26 05:38:13.092152 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 546/1071] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:12 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1548 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:38:13.118970 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-12b01d1a-7f02-42e5-9757-74d6829dc6d1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:13.119592 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-12b01d1a-7f02-42e5-9757-74d6829dc6d1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:13.125899 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12b01d1a-7f02-42e5-9757-74d6829dc6d1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:13.126808 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12b01d1a-7f02-42e5-9757-74d6829dc6d1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:13.127506 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12b01d1a-7f02-42e5-9757-74d6829dc6d1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:13.128438 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12b01d1a-7f02-42e5-9757-74d6829dc6d1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:13.129391 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12b01d1a-7f02-42e5-9757-74d6829dc6d1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:13.130151 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12b01d1a-7f02-42e5-9757-74d6829dc6d1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:13.377386 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-12b01d1a-7f02-42e5-9757-74d6829dc6d1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:13.385933 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-12b01d1a-7f02-42e5-9757-74d6829dc6d1 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1548 microversion: 2.1 time: 0.270648 Sep 26 05:38:13.386423 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 526/1072] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:13 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1548 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:13.410065 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-de441d53-4e5e-4f9e-b25e-1cb217cd610b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:13.415446 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-de441d53-4e5e-4f9e-b25e-1cb217cd610b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:13.416369 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-de441d53-4e5e-4f9e-b25e-1cb217cd610b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Searching by: {'deleted': False, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1'} {{(pid=120806) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 26 05:38:13.423577 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de441d53-4e5e-4f9e-b25e-1cb217cd610b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:13.424060 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de441d53-4e5e-4f9e-b25e-1cb217cd610b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:13.424543 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de441d53-4e5e-4f9e-b25e-1cb217cd610b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:13.425854 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de441d53-4e5e-4f9e-b25e-1cb217cd610b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:13.425854 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de441d53-4e5e-4f9e-b25e-1cb217cd610b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:13.426134 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-de441d53-4e5e-4f9e-b25e-1cb217cd610b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:13.519388 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.multi_cell_list [None req-de441d53-4e5e-4f9e-b25e-1cb217cd610b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120806) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 26 05:38:13.624712 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-de441d53-4e5e-4f9e-b25e-1cb217cd610b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.219548 Sep 26 05:38:13.625765 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 547/1073] 10.222.0.49 () {58 vars in 1125 bytes} [Mon Sep 26 05:38:13 2022] GET /compute/v2.1/servers => generated 342 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:38:13.638490 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ec35fe98-3fce-48b3-9a93-0b6aa8b3cec5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:13.639327 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ec35fe98-3fce-48b3-9a93-0b6aa8b3cec5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:13.645371 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec35fe98-3fce-48b3-9a93-0b6aa8b3cec5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:13.645949 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec35fe98-3fce-48b3-9a93-0b6aa8b3cec5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:13.646384 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec35fe98-3fce-48b3-9a93-0b6aa8b3cec5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:13.647434 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec35fe98-3fce-48b3-9a93-0b6aa8b3cec5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:13.648040 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec35fe98-3fce-48b3-9a93-0b6aa8b3cec5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:13.648640 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec35fe98-3fce-48b3-9a93-0b6aa8b3cec5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:13.867352 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ec35fe98-3fce-48b3-9a93-0b6aa8b3cec5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:13.879797 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ec35fe98-3fce-48b3-9a93-0b6aa8b3cec5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1548 microversion: 2.1 time: 0.246145 Sep 26 05:38:13.884688 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 527/1074] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:13 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1548 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:15.566967 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a8148626-5ee6-4d36-a12e-7dc977c2838d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc9dcdfc-6113-4d10-b7a4-f2c40d8e4f8d"}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:38:15.569449 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a8148626-5ee6-4d36-a12e-7dc977c2838d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:15.577519 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a8148626-5ee6-4d36-a12e-7dc977c2838d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:15.578412 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a8148626-5ee6-4d36-a12e-7dc977c2838d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:15.579053 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a8148626-5ee6-4d36-a12e-7dc977c2838d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:15.580574 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a8148626-5ee6-4d36-a12e-7dc977c2838d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:15.581123 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a8148626-5ee6-4d36-a12e-7dc977c2838d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:15.581702 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a8148626-5ee6-4d36-a12e-7dc977c2838d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:15.869959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a8148626-5ee6-4d36-a12e-7dc977c2838d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "POST /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306841 Sep 26 05:38:15.871292 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 548/1075] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 05:38:15 2022] POST /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:38:23.595671 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e7ad1a07-2ace-41ee-b949-d731cc5fd26e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:23.596419 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e7ad1a07-2ace-41ee-b949-d731cc5fd26e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:23.605913 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e7ad1a07-2ace-41ee-b949-d731cc5fd26e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:23.607431 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e7ad1a07-2ace-41ee-b949-d731cc5fd26e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:23.608448 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e7ad1a07-2ace-41ee-b949-d731cc5fd26e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:23.609543 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e7ad1a07-2ace-41ee-b949-d731cc5fd26e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:23.610245 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e7ad1a07-2ace-41ee-b949-d731cc5fd26e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:23.612899 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e7ad1a07-2ace-41ee-b949-d731cc5fd26e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:23.771153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e7ad1a07-2ace-41ee-b949-d731cc5fd26e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:23.781599 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e7ad1a07-2ace-41ee-b949-d731cc5fd26e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1594 microversion: 2.1 time: 0.191866 Sep 26 05:38:23.782088 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 528/1076] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:23 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1594 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:38:25.911123 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:25.911922 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=5 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:25.912616 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:25.917790 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-e0a16e4c-cfe2-4113-bfdb-44bed5fded00 req-8410f2b5-954d-48c1-aa90-24af8181982e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2df85633-fcf8-4640-bfac-ffc0f55778ac", "tag": "3211bad3-a3ee-47c8-a87f-240818a7928b"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:38:25.932564 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-e0a16e4c-cfe2-4113-bfdb-44bed5fded00 req-8410f2b5-954d-48c1-aa90-24af8181982e service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:25.933052 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-e0a16e4c-cfe2-4113-bfdb-44bed5fded00 req-8410f2b5-954d-48c1-aa90-24af8181982e service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:25.933507 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-e0a16e4c-cfe2-4113-bfdb-44bed5fded00 req-8410f2b5-954d-48c1-aa90-24af8181982e service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:25.948701 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-e0a16e4c-cfe2-4113-bfdb-44bed5fded00 req-8410f2b5-954d-48c1-aa90-24af8181982e service nova] Creating event network-changed:3211bad3-a3ee-47c8-a87f-240818a7928b for instance 2df85633-fcf8-4640-bfac-ffc0f55778ac on hv-cinder-85918 Sep 26 05:38:25.955868 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-e0a16e4c-cfe2-4113-bfdb-44bed5fded00 req-8410f2b5-954d-48c1-aa90-24af8181982e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045795 Sep 26 05:38:25.956498 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 549/1077] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:38:26.930692 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cee0a982-16a3-4dbc-92a7-448211ff7291 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-999543659", "imageRef": "d37a4f3d-6311-48af-9e33-4c62c14cdd1a", "flavorRef": "452", "networks": [{"uuid": "3f90c229-cdcb-41cd-bb83-7856e14af107"}]}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:38:27.004103 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-cee0a982-16a3-4dbc-92a7-448211ff7291 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] validate_networks() for [('3f90c229-cdcb-41cd-bb83-7856e14af107', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:38:27.025059 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7f56d975-1fb9-4848-8b65-9ef4f0b71961 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-232110990"}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:38:27.026322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7f56d975-1fb9-4848-8b65-9ef4f0b71961 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:27.034876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7f56d975-1fb9-4848-8b65-9ef4f0b71961 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:27.035675 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7f56d975-1fb9-4848-8b65-9ef4f0b71961 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:27.036326 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7f56d975-1fb9-4848-8b65-9ef4f0b71961 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:27.037501 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7f56d975-1fb9-4848-8b65-9ef4f0b71961 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:27.038175 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7f56d975-1fb9-4848-8b65-9ef4f0b71961 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:27.039791 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7f56d975-1fb9-4848-8b65-9ef4f0b71961 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:27.247324 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.network.security_group_api [None req-7f56d975-1fb9-4848-8b65-9ef4f0b71961 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Adding security group beb46e1e-e3d5-4418-93f8-6107d39b0841 to port 3211bad3-a3ee-47c8-a87f-240818a7928b Sep 26 05:38:27.632929 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-cee0a982-16a3-4dbc-92a7-448211ff7291 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:38:27.633560 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-cee0a982-16a3-4dbc-92a7-448211ff7291 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:38:27.634040 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-cee0a982-16a3-4dbc-92a7-448211ff7291 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:38:27.634475 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-cee0a982-16a3-4dbc-92a7-448211ff7291 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:38:27.635059 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-cee0a982-16a3-4dbc-92a7-448211ff7291 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:38:27.645603 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cee0a982-16a3-4dbc-92a7-448211ff7291 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:27.646082 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cee0a982-16a3-4dbc-92a7-448211ff7291 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:27.646508 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cee0a982-16a3-4dbc-92a7-448211ff7291 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:27.647395 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cee0a982-16a3-4dbc-92a7-448211ff7291 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:27.647852 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cee0a982-16a3-4dbc-92a7-448211ff7291 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:27.648295 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cee0a982-16a3-4dbc-92a7-448211ff7291 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:27.666021 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-cee0a982-16a3-4dbc-92a7-448211ff7291 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Getting quotas for project 741fd985226b460a93af30e55719aab2. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:38:27.670565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-cee0a982-16a3-4dbc-92a7-448211ff7291 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Getting quotas for user e40ff402e4f74abaae63a8230885827b and project 741fd985226b460a93af30e55719aab2. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:38:27.682917 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cee0a982-16a3-4dbc-92a7-448211ff7291 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:38:27.686040 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cee0a982-16a3-4dbc-92a7-448211ff7291 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 3d34da53-72ea-475c-9422-2affe1a4200b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d37a4f3d-6311-48af-9e33-4c62c14cdd1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:38:27.735923 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7f56d975-1fb9-4848-8b65-9ef4f0b71961 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "POST /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac/action" status: 202 len: 0 microversion: 2.1 time: 0.715912 Sep 26 05:38:27.736695 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 550/1078] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 05:38:27 2022] POST /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac/action => generated 0 bytes in 718 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:38:27.744352 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c54091f3-68d0-4763-9fc9-55aee5929dfb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:27.745285 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c54091f3-68d0-4763-9fc9-55aee5929dfb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:27.753640 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c54091f3-68d0-4763-9fc9-55aee5929dfb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:27.754355 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c54091f3-68d0-4763-9fc9-55aee5929dfb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:27.755019 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c54091f3-68d0-4763-9fc9-55aee5929dfb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:27.756696 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c54091f3-68d0-4763-9fc9-55aee5929dfb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:27.757605 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c54091f3-68d0-4763-9fc9-55aee5929dfb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:27.758780 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c54091f3-68d0-4763-9fc9-55aee5929dfb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:27.763183 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cee0a982-16a3-4dbc-92a7-448211ff7291 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835112 Sep 26 05:38:27.766533 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 529/1079] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:38:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 26 05:38:27.780876 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4cc79f71-4aaf-4a90-b2cf-d31d86055c36 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:27.781497 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4cc79f71-4aaf-4a90-b2cf-d31d86055c36 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 3d34da53-72ea-475c-9422-2affe1a4200b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:27.911761 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4cc79f71-4aaf-4a90-b2cf-d31d86055c36 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:27.923518 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4cc79f71-4aaf-4a90-b2cf-d31d86055c36 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b" status: 200 len: 1213 microversion: 2.1 time: 0.146468 Sep 26 05:38:27.937907 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 530/1080] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:27 2022] GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b => generated 1213 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:27.976990 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-23c916cb-7948-4e92-91a1-15cb05cf8836 req-37eb9d3a-a67d-4413-8053-a84bd0f87f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2df85633-fcf8-4640-bfac-ffc0f55778ac", "tag": "3211bad3-a3ee-47c8-a87f-240818a7928b"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:38:27.998565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-23c916cb-7948-4e92-91a1-15cb05cf8836 req-37eb9d3a-a67d-4413-8053-a84bd0f87f55 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:27.999336 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-23c916cb-7948-4e92-91a1-15cb05cf8836 req-37eb9d3a-a67d-4413-8053-a84bd0f87f55 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:27.999916 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-23c916cb-7948-4e92-91a1-15cb05cf8836 req-37eb9d3a-a67d-4413-8053-a84bd0f87f55 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:28.011212 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-23c916cb-7948-4e92-91a1-15cb05cf8836 req-37eb9d3a-a67d-4413-8053-a84bd0f87f55 service nova] Creating event network-changed:3211bad3-a3ee-47c8-a87f-240818a7928b for instance 2df85633-fcf8-4640-bfac-ffc0f55778ac on hv-cinder-85918 Sep 26 05:38:28.019261 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-23c916cb-7948-4e92-91a1-15cb05cf8836 req-37eb9d3a-a67d-4413-8053-a84bd0f87f55 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050803 Sep 26 05:38:28.019957 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-c54091f3-68d0-4763-9fc9-55aee5929dfb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:28.020689 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 531/1081] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:38:28.037389 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c54091f3-68d0-4763-9fc9-55aee5929dfb tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1758 microversion: 2.1 time: 0.296574 Sep 26 05:38:28.038492 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 551/1082] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:27 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1758 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:38:28.951817 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f8f174af-0594-443f-b1fc-08b253bfe0ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:28.952695 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f8f174af-0594-443f-b1fc-08b253bfe0ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 3d34da53-72ea-475c-9422-2affe1a4200b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:28.962303 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f8f174af-0594-443f-b1fc-08b253bfe0ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:28.963018 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f8f174af-0594-443f-b1fc-08b253bfe0ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:28.963670 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f8f174af-0594-443f-b1fc-08b253bfe0ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:28.967681 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f8f174af-0594-443f-b1fc-08b253bfe0ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:28.969404 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f8f174af-0594-443f-b1fc-08b253bfe0ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:28.970082 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f8f174af-0594-443f-b1fc-08b253bfe0ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:29.045763 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f8f174af-0594-443f-b1fc-08b253bfe0ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:29.058892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f8f174af-0594-443f-b1fc-08b253bfe0ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b" status: 200 len: 1265 microversion: 2.1 time: 0.114826 Sep 26 05:38:29.060086 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 532/1083] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:28 2022] GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b => generated 1265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:30.084190 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7d1ab699-d9d5-4990-9e74-86a52557b527 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:30.085036 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7d1ab699-d9d5-4990-9e74-86a52557b527 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 3d34da53-72ea-475c-9422-2affe1a4200b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:30.093327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7d1ab699-d9d5-4990-9e74-86a52557b527 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:30.093904 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7d1ab699-d9d5-4990-9e74-86a52557b527 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:30.094415 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7d1ab699-d9d5-4990-9e74-86a52557b527 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:30.095449 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7d1ab699-d9d5-4990-9e74-86a52557b527 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:30.096297 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7d1ab699-d9d5-4990-9e74-86a52557b527 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:30.096937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7d1ab699-d9d5-4990-9e74-86a52557b527 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:30.297643 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7d1ab699-d9d5-4990-9e74-86a52557b527 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:30.305322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7d1ab699-d9d5-4990-9e74-86a52557b527 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b" status: 200 len: 1313 microversion: 2.1 time: 0.226278 Sep 26 05:38:30.305883 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 552/1084] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:30 2022] GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:30.695714 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-86f38db7-efaf-4d09-8bff-f9ad8a6a9258 req-db73f18a-f27d-49f2-a6dc-b3b79b5f061c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d34da53-72ea-475c-9422-2affe1a4200b", "tag": "3a68ab47-234f-4838-b521-c414edf4a944"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:38:30.706195 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-86f38db7-efaf-4d09-8bff-f9ad8a6a9258 req-db73f18a-f27d-49f2-a6dc-b3b79b5f061c service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:30.707088 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-86f38db7-efaf-4d09-8bff-f9ad8a6a9258 req-db73f18a-f27d-49f2-a6dc-b3b79b5f061c service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:30.707522 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-86f38db7-efaf-4d09-8bff-f9ad8a6a9258 req-db73f18a-f27d-49f2-a6dc-b3b79b5f061c service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:30.711586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=83 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:30.722000 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-86f38db7-efaf-4d09-8bff-f9ad8a6a9258 req-db73f18a-f27d-49f2-a6dc-b3b79b5f061c service nova] Creating event network-changed:3a68ab47-234f-4838-b521-c414edf4a944 for instance 3d34da53-72ea-475c-9422-2affe1a4200b on hv-cinder-85918 Sep 26 05:38:30.728913 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-86f38db7-efaf-4d09-8bff-f9ad8a6a9258 req-db73f18a-f27d-49f2-a6dc-b3b79b5f061c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036350 Sep 26 05:38:30.730290 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 533/1085] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:38:31.328360 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-362d9b7d-87ff-47f5-a078-1c3c60750066 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:31.328891 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-362d9b7d-87ff-47f5-a078-1c3c60750066 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 3d34da53-72ea-475c-9422-2affe1a4200b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:31.335097 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-362d9b7d-87ff-47f5-a078-1c3c60750066 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:31.335573 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-362d9b7d-87ff-47f5-a078-1c3c60750066 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:31.336001 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-362d9b7d-87ff-47f5-a078-1c3c60750066 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:31.336716 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-362d9b7d-87ff-47f5-a078-1c3c60750066 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:31.337193 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-362d9b7d-87ff-47f5-a078-1c3c60750066 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:31.337617 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-362d9b7d-87ff-47f5-a078-1c3c60750066 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:31.473350 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-362d9b7d-87ff-47f5-a078-1c3c60750066 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:31.482384 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-362d9b7d-87ff-47f5-a078-1c3c60750066 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b" status: 200 len: 1313 microversion: 2.1 time: 0.157916 Sep 26 05:38:31.482953 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 553/1086] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:31 2022] GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:38:32.507582 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8a6cdb3e-3353-4029-9a93-d3678c2efe40 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:32.508306 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8a6cdb3e-3353-4029-9a93-d3678c2efe40 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 3d34da53-72ea-475c-9422-2affe1a4200b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:32.514648 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8a6cdb3e-3353-4029-9a93-d3678c2efe40 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:32.515136 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8a6cdb3e-3353-4029-9a93-d3678c2efe40 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:32.515579 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8a6cdb3e-3353-4029-9a93-d3678c2efe40 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:32.516289 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8a6cdb3e-3353-4029-9a93-d3678c2efe40 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:32.516748 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8a6cdb3e-3353-4029-9a93-d3678c2efe40 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:32.517171 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8a6cdb3e-3353-4029-9a93-d3678c2efe40 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:32.651521 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8a6cdb3e-3353-4029-9a93-d3678c2efe40 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:32.659877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8a6cdb3e-3353-4029-9a93-d3678c2efe40 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b" status: 200 len: 1313 microversion: 2.1 time: 0.157176 Sep 26 05:38:32.660480 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 534/1087] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:32 2022] GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:33.684544 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-2d00e6d0-179d-427f-8dbc-ed155abafb1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:33.685233 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-2d00e6d0-179d-427f-8dbc-ed155abafb1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 3d34da53-72ea-475c-9422-2affe1a4200b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:33.692143 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2d00e6d0-179d-427f-8dbc-ed155abafb1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:33.692726 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2d00e6d0-179d-427f-8dbc-ed155abafb1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:33.693190 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2d00e6d0-179d-427f-8dbc-ed155abafb1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:33.693942 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2d00e6d0-179d-427f-8dbc-ed155abafb1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:33.694390 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2d00e6d0-179d-427f-8dbc-ed155abafb1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:33.694858 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2d00e6d0-179d-427f-8dbc-ed155abafb1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:33.826590 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2d00e6d0-179d-427f-8dbc-ed155abafb1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:33.834440 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2d00e6d0-179d-427f-8dbc-ed155abafb1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b" status: 200 len: 1313 microversion: 2.1 time: 0.154541 Sep 26 05:38:33.835023 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 554/1088] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:33 2022] GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:34.857976 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-67f8da8c-bf14-4578-9f2b-2e836c298fd7 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:34.859250 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-67f8da8c-bf14-4578-9f2b-2e836c298fd7 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 3d34da53-72ea-475c-9422-2affe1a4200b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:34.865746 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-67f8da8c-bf14-4578-9f2b-2e836c298fd7 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:34.866235 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-67f8da8c-bf14-4578-9f2b-2e836c298fd7 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:34.866672 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-67f8da8c-bf14-4578-9f2b-2e836c298fd7 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:34.867382 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-67f8da8c-bf14-4578-9f2b-2e836c298fd7 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:34.867839 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-67f8da8c-bf14-4578-9f2b-2e836c298fd7 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:34.868286 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-67f8da8c-bf14-4578-9f2b-2e836c298fd7 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:34.931331 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-5da62384-1d98-425b-980c-b40cbcf41632 req-896cdd84-6b13-428c-a3c8-a131a3cd2066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d34da53-72ea-475c-9422-2affe1a4200b", "name": "network-vif-plugged", "status": "completed", "tag": "3a68ab47-234f-4838-b521-c414edf4a944"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:38:34.950862 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-5da62384-1d98-425b-980c-b40cbcf41632 req-896cdd84-6b13-428c-a3c8-a131a3cd2066 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:34.951730 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-5da62384-1d98-425b-980c-b40cbcf41632 req-896cdd84-6b13-428c-a3c8-a131a3cd2066 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:34.953136 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-5da62384-1d98-425b-980c-b40cbcf41632 req-896cdd84-6b13-428c-a3c8-a131a3cd2066 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:34.966602 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-5da62384-1d98-425b-980c-b40cbcf41632 req-896cdd84-6b13-428c-a3c8-a131a3cd2066 service nova] Creating event network-vif-plugged:3a68ab47-234f-4838-b521-c414edf4a944 for instance 3d34da53-72ea-475c-9422-2affe1a4200b on hv-cinder-85918 Sep 26 05:38:34.973992 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-5da62384-1d98-425b-980c-b40cbcf41632 req-896cdd84-6b13-428c-a3c8-a131a3cd2066 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047279 Sep 26 05:38:34.975197 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 555/1089] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:38:35.260523 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-67f8da8c-bf14-4578-9f2b-2e836c298fd7 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:35.268994 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-67f8da8c-bf14-4578-9f2b-2e836c298fd7 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b" status: 200 len: 1313 microversion: 2.1 time: 0.415079 Sep 26 05:38:35.269495 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 535/1090] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:34 2022] GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:36.293539 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9ca42fa9-fb5c-4d0e-a7fc-9d1bf4409d1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:36.294244 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-9ca42fa9-fb5c-4d0e-a7fc-9d1bf4409d1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 3d34da53-72ea-475c-9422-2affe1a4200b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:36.300873 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9ca42fa9-fb5c-4d0e-a7fc-9d1bf4409d1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:36.301361 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9ca42fa9-fb5c-4d0e-a7fc-9d1bf4409d1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:36.301792 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9ca42fa9-fb5c-4d0e-a7fc-9d1bf4409d1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:36.302519 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9ca42fa9-fb5c-4d0e-a7fc-9d1bf4409d1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:36.302968 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9ca42fa9-fb5c-4d0e-a7fc-9d1bf4409d1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:36.303390 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9ca42fa9-fb5c-4d0e-a7fc-9d1bf4409d1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:36.437365 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-9ca42fa9-fb5c-4d0e-a7fc-9d1bf4409d1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:36.445149 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-9ca42fa9-fb5c-4d0e-a7fc-9d1bf4409d1f tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b" status: 200 len: 1313 microversion: 2.1 time: 0.155775 Sep 26 05:38:36.445712 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 556/1091] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:36 2022] GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:37.469541 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-43c8bc94-ceb6-4c36-9112-1cb159ee9951 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:37.470419 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-43c8bc94-ceb6-4c36-9112-1cb159ee9951 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 3d34da53-72ea-475c-9422-2affe1a4200b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:37.476990 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43c8bc94-ceb6-4c36-9112-1cb159ee9951 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:37.477479 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43c8bc94-ceb6-4c36-9112-1cb159ee9951 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:37.477922 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43c8bc94-ceb6-4c36-9112-1cb159ee9951 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:37.478621 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43c8bc94-ceb6-4c36-9112-1cb159ee9951 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:37.479082 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43c8bc94-ceb6-4c36-9112-1cb159ee9951 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:37.479512 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43c8bc94-ceb6-4c36-9112-1cb159ee9951 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:37.612268 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-43c8bc94-ceb6-4c36-9112-1cb159ee9951 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:37.620004 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-43c8bc94-ceb6-4c36-9112-1cb159ee9951 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b" status: 200 len: 1497 microversion: 2.1 time: 0.154449 Sep 26 05:38:37.620658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 536/1092] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:37 2022] GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:38.109647 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5b44b680-c884-43d4-b5d6-1beb7bb99580 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:38.110198 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5b44b680-c884-43d4-b5d6-1beb7bb99580 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 3d34da53-72ea-475c-9422-2affe1a4200b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:38.118941 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5b44b680-c884-43d4-b5d6-1beb7bb99580 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:38.119420 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5b44b680-c884-43d4-b5d6-1beb7bb99580 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:38.119849 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5b44b680-c884-43d4-b5d6-1beb7bb99580 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:38.121248 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5b44b680-c884-43d4-b5d6-1beb7bb99580 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:38.121709 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5b44b680-c884-43d4-b5d6-1beb7bb99580 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:38.122129 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5b44b680-c884-43d4-b5d6-1beb7bb99580 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:38.148527 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5b44b680-c884-43d4-b5d6-1beb7bb99580 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 3d34da53-72ea-475c-9422-2affe1a4200b] Going to try to terminate instance {{(pid=120806) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:38:38.228558 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5b44b680-c884-43d4-b5d6-1beb7bb99580 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b" status: 204 len: 0 microversion: 2.1 time: 0.123301 Sep 26 05:38:38.229144 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 557/1093] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:38:38 2022] DELETE /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:38:38.237685 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d0b86bbf-2e2c-4151-9b4c-4b673b0ea7fe tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:38.238309 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d0b86bbf-2e2c-4151-9b4c-4b673b0ea7fe tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 3d34da53-72ea-475c-9422-2affe1a4200b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:38.240278 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:38.241208 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=8 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:38.248300 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0b86bbf-2e2c-4151-9b4c-4b673b0ea7fe tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:38.248800 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0b86bbf-2e2c-4151-9b4c-4b673b0ea7fe tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:38.249240 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0b86bbf-2e2c-4151-9b4c-4b673b0ea7fe tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:38.249941 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0b86bbf-2e2c-4151-9b4c-4b673b0ea7fe tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:38.250410 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0b86bbf-2e2c-4151-9b4c-4b673b0ea7fe tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:38.250817 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0b86bbf-2e2c-4151-9b4c-4b673b0ea7fe tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:38.379762 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d0b86bbf-2e2c-4151-9b4c-4b673b0ea7fe tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:38.388139 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d0b86bbf-2e2c-4151-9b4c-4b673b0ea7fe tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b" status: 200 len: 1503 microversion: 2.1 time: 0.154374 Sep 26 05:38:38.388736 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 537/1094] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:38 2022] GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:39.411534 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a6cf42db-4853-484e-befc-f0fd8b5d6ca3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:39.412170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a6cf42db-4853-484e-befc-f0fd8b5d6ca3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 3d34da53-72ea-475c-9422-2affe1a4200b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:39.419709 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6cf42db-4853-484e-befc-f0fd8b5d6ca3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:39.420180 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6cf42db-4853-484e-befc-f0fd8b5d6ca3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:39.420849 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6cf42db-4853-484e-befc-f0fd8b5d6ca3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:39.421659 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6cf42db-4853-484e-befc-f0fd8b5d6ca3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:39.422262 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6cf42db-4853-484e-befc-f0fd8b5d6ca3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:39.422771 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a6cf42db-4853-484e-befc-f0fd8b5d6ca3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:39.560713 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a6cf42db-4853-484e-befc-f0fd8b5d6ca3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:39.568383 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a6cf42db-4853-484e-befc-f0fd8b5d6ca3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b" status: 200 len: 1503 microversion: 2.1 time: 0.161105 Sep 26 05:38:39.568937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 558/1095] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:39 2022] GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:40.553726 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-e7751956-ffeb-40fa-8aaa-0d6cea7af1e6 req-fed83030-33a7-49f0-8598-9b5802e042b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d34da53-72ea-475c-9422-2affe1a4200b", "name": "network-vif-deleted", "tag": "3a68ab47-234f-4838-b521-c414edf4a944"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:38:40.566847 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-e7751956-ffeb-40fa-8aaa-0d6cea7af1e6 req-fed83030-33a7-49f0-8598-9b5802e042b0 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:40.567350 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-e7751956-ffeb-40fa-8aaa-0d6cea7af1e6 req-fed83030-33a7-49f0-8598-9b5802e042b0 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:40.567785 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-e7751956-ffeb-40fa-8aaa-0d6cea7af1e6 req-fed83030-33a7-49f0-8598-9b5802e042b0 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:40.582689 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-e7751956-ffeb-40fa-8aaa-0d6cea7af1e6 req-fed83030-33a7-49f0-8598-9b5802e042b0 service nova] Creating event network-vif-deleted:3a68ab47-234f-4838-b521-c414edf4a944 for instance 3d34da53-72ea-475c-9422-2affe1a4200b on hv-cinder-85918 Sep 26 05:38:40.593973 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-abe9654f-e139-4ea2-b8ec-03658cd9d102 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:40.595279 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-abe9654f-e139-4ea2-b8ec-03658cd9d102 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 3d34da53-72ea-475c-9422-2affe1a4200b] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:40.601713 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-e7751956-ffeb-40fa-8aaa-0d6cea7af1e6 req-fed83030-33a7-49f0-8598-9b5802e042b0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051593 Sep 26 05:38:40.602449 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 538/1096] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:38:40.602763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-abe9654f-e139-4ea2-b8ec-03658cd9d102 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:40.603505 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-abe9654f-e139-4ea2-b8ec-03658cd9d102 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:40.604314 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-abe9654f-e139-4ea2-b8ec-03658cd9d102 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:40.605222 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-abe9654f-e139-4ea2-b8ec-03658cd9d102 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:40.606213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-abe9654f-e139-4ea2-b8ec-03658cd9d102 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:40.606666 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-abe9654f-e139-4ea2-b8ec-03658cd9d102 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:40.672650 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-abe9654f-e139-4ea2-b8ec-03658cd9d102 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:40.681522 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-abe9654f-e139-4ea2-b8ec-03658cd9d102 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b" status: 200 len: 1298 microversion: 2.1 time: 0.093941 Sep 26 05:38:40.687537 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 559/1097] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:40 2022] GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:41.707200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2a7d7bff-94ba-442b-8312-ca693a53b474 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:41.707907 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2a7d7bff-94ba-442b-8312-ca693a53b474 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 3d34da53-72ea-475c-9422-2affe1a4200b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:41.715017 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a7d7bff-94ba-442b-8312-ca693a53b474 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:41.715584 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a7d7bff-94ba-442b-8312-ca693a53b474 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:41.716024 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a7d7bff-94ba-442b-8312-ca693a53b474 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:41.716746 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a7d7bff-94ba-442b-8312-ca693a53b474 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:41.717203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a7d7bff-94ba-442b-8312-ca693a53b474 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:41.717628 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a7d7bff-94ba-442b-8312-ca693a53b474 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:41.731934 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-2a7d7bff-94ba-442b-8312-ca693a53b474 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] HTTP exception thrown: Instance 3d34da53-72ea-475c-9422-2affe1a4200b could not be found. Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2a7d7bff-94ba-442b-8312-ca693a53b474 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Request method failure captured: Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b HTTP/1.1 Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTrRDd7cdh6Z8TyeaZAmWLoGEzkQr---TcevVFpPT4j5bHVaBGU1gsE38CbgsSSwUn1xfLc3S4MskR1CRXK2PwUweQKew2nWeA9EBU972sqZM0rNeihVI7bxDTfZXS4nYKW3EK66Fjej6tO6qJXi2q6zAG8qKvHrm2jBdtLPYuOIOYc Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: 741fd985226b460a93af30e55719aab2 Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-VolumesActionsTest-541034204 Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:38:41.733655 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:38:41.735334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/741fd985226b460a93af30e55719aab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/741fd985226b460a93af30e55719aab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/741fd985226b460a93af30e55719aab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_741fd985226b460a93af30e55719aab2"}]}] Sep 26 05:38:41.735334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-VolumesActionsTest-541034204 Sep 26 05:38:41.735334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 741fd985226b460a93af30e55719aab2 Sep 26 05:38:41.735334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-VolumesActionsTest-541034204 Sep 26 05:38:41.735334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-VolumesActionsTest-541034204-project Sep 26 05:38:41.735334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:38:41.735334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:38:41.735334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: e40ff402e4f74abaae63a8230885827b Sep 26 05:38:41.735334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-VolumesActionsTest-541034204-project Sep 26 05:38:41.735334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:38:41.735334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance 3d34da53-72ea-475c-9422-2affe1a4200b could not be found. Sep 26 05:38:41.735334 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': '3d34da53-72ea-475c-9422-2affe1a4200b'} Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d34da53-72ea-475c-9422-2affe1a4200b could not be found. Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:38:41.736514 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:38:41.738129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:38:41.738129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:38:41.738129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:38:41.738129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:38:41.738129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:38:41.738129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:38:41.738129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:38:41.738129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d34da53-72ea-475c-9422-2affe1a4200b could not be found. Sep 26 05:38:41.738129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:41.738129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:38:41.738129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:41.738129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:38:41.738129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:38:41.738129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:38:41.738129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:38:41.738129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:38:41.738129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d34da53-72ea-475c-9422-2affe1a4200b could not be found. Sep 26 05:38:41.738129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:38:41.739563 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2a7d7bff-94ba-442b-8312-ca693a53b474 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Returning 404 to user: Instance 3d34da53-72ea-475c-9422-2affe1a4200b could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:38:41.739563 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2a7d7bff-94ba-442b-8312-ca693a53b474 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b" status: 404 len: 111 microversion: 2.1 time: 0.032657 Sep 26 05:38:41.739563 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 539/1098] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:41 2022] GET /compute/v2.1/servers/3d34da53-72ea-475c-9422-2affe1a4200b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:38:41.833467 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2041601963", "imageRef": "d37a4f3d-6311-48af-9e33-4c62c14cdd1a", "flavorRef": "452", "networks": [{"uuid": "3f90c229-cdcb-41cd-bb83-7856e14af107"}]}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:38:41.892813 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.network.neutron [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] validate_networks() for [('3f90c229-cdcb-41cd-bb83-7856e14af107', None, None, None, None, None)] {{(pid=120806) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:38:42.246403 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Flavor limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:38:42.246856 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Image limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:38:42.247353 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Flavor pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:38:42.247775 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Image pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:38:42.248215 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:38:42.257001 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:42.257474 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:42.257900 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:42.258612 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:42.259061 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:42.259480 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:42.277736 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Getting quotas for project 741fd985226b460a93af30e55719aab2. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:38:42.281980 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Getting quotas for user e40ff402e4f74abaae63a8230885827b and project 741fd985226b460a93af30e55719aab2. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:38:42.293545 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Going to run 1 instances... {{(pid=120806) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:38:42.295691 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d37a4f3d-6311-48af-9e33-4c62c14cdd1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120806) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:38:42.341357 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR oslo.messaging._drivers.impl_rabbit [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [02dc9478-e87d-404b-b74a-bf385bf9e863] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 26 05:38:43.350455 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO oslo.messaging._drivers.impl_rabbit [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [02dc9478-e87d-404b-b74a-bf385bf9e863] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 45854. Sep 26 05:38:43.354506 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-473880f1-8e0c-47e3-a580-e2124778851a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.525028 Sep 26 05:38:43.355148 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 560/1099] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:38:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:38:43.366913 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8af1d353-2125-4251-a976-ba7ce39d4b91 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:43.367525 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8af1d353-2125-4251-a976-ba7ce39d4b91 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:43.369952 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:43.425153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8af1d353-2125-4251-a976-ba7ce39d4b91 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:43.433033 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8af1d353-2125-4251-a976-ba7ce39d4b91 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 200 len: 1214 microversion: 2.1 time: 0.069888 Sep 26 05:38:43.433780 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 540/1100] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:43 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:44.457011 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-ed8c0e17-09a4-4bc7-ad8d-e355dd27a7ea tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:44.457625 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-ed8c0e17-09a4-4bc7-ad8d-e355dd27a7ea tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:44.465269 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ed8c0e17-09a4-4bc7-ad8d-e355dd27a7ea tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:44.466138 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ed8c0e17-09a4-4bc7-ad8d-e355dd27a7ea tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:44.466790 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ed8c0e17-09a4-4bc7-ad8d-e355dd27a7ea tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:44.467671 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ed8c0e17-09a4-4bc7-ad8d-e355dd27a7ea tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:44.468322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ed8c0e17-09a4-4bc7-ad8d-e355dd27a7ea tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:44.468918 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ed8c0e17-09a4-4bc7-ad8d-e355dd27a7ea tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:44.549952 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-ed8c0e17-09a4-4bc7-ad8d-e355dd27a7ea tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:44.557766 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-ed8c0e17-09a4-4bc7-ad8d-e355dd27a7ea tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 200 len: 1274 microversion: 2.1 time: 0.105212 Sep 26 05:38:44.558511 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 561/1101] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:44 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:38:45.592489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b5babe70-e0d8-40d8-9e87-075f6184bc84 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:45.592489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b5babe70-e0d8-40d8-9e87-075f6184bc84 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:45.592489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b5babe70-e0d8-40d8-9e87-075f6184bc84 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:45.592489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b5babe70-e0d8-40d8-9e87-075f6184bc84 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:45.593217 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b5babe70-e0d8-40d8-9e87-075f6184bc84 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:45.593217 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b5babe70-e0d8-40d8-9e87-075f6184bc84 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:45.593217 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b5babe70-e0d8-40d8-9e87-075f6184bc84 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:45.593537 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b5babe70-e0d8-40d8-9e87-075f6184bc84 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:45.727897 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b5babe70-e0d8-40d8-9e87-075f6184bc84 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:45.736590 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b5babe70-e0d8-40d8-9e87-075f6184bc84 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 200 len: 1314 microversion: 2.1 time: 0.156618 Sep 26 05:38:45.737328 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 541/1102] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:45 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:45.774225 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-50b7188c-b80d-4257-b182-2805420d166b req-86e7f1b2-f9a4-4415-9302-977c601f670b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e110bd9-f6bc-409e-beb6-2795aebc59f9", "tag": "e8eec1dd-e7cd-4910-b584-d07e93b3bb08"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:38:45.785933 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-50b7188c-b80d-4257-b182-2805420d166b req-86e7f1b2-f9a4-4415-9302-977c601f670b service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:45.786426 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-50b7188c-b80d-4257-b182-2805420d166b req-86e7f1b2-f9a4-4415-9302-977c601f670b service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:45.786865 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-50b7188c-b80d-4257-b182-2805420d166b req-86e7f1b2-f9a4-4415-9302-977c601f670b service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:45.800442 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-50b7188c-b80d-4257-b182-2805420d166b req-86e7f1b2-f9a4-4415-9302-977c601f670b service nova] Creating event network-changed:e8eec1dd-e7cd-4910-b584-d07e93b3bb08 for instance 1e110bd9-f6bc-409e-beb6-2795aebc59f9 on hv-cinder-85918 Sep 26 05:38:45.805157 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-50b7188c-b80d-4257-b182-2805420d166b req-86e7f1b2-f9a4-4415-9302-977c601f670b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034845 Sep 26 05:38:45.805765 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 562/1103] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:38:46.759818 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ec9011f2-d93f-4bd0-8623-fbe1fa4e9faf tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:46.760468 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ec9011f2-d93f-4bd0-8623-fbe1fa4e9faf tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:46.766995 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec9011f2-d93f-4bd0-8623-fbe1fa4e9faf tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:46.767479 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec9011f2-d93f-4bd0-8623-fbe1fa4e9faf tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:46.767919 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec9011f2-d93f-4bd0-8623-fbe1fa4e9faf tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:46.768625 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec9011f2-d93f-4bd0-8623-fbe1fa4e9faf tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:46.769086 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec9011f2-d93f-4bd0-8623-fbe1fa4e9faf tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:46.769511 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec9011f2-d93f-4bd0-8623-fbe1fa4e9faf tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:46.896815 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ec9011f2-d93f-4bd0-8623-fbe1fa4e9faf tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:46.904505 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ec9011f2-d93f-4bd0-8623-fbe1fa4e9faf tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 200 len: 1314 microversion: 2.1 time: 0.148575 Sep 26 05:38:46.905065 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 542/1104] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:46 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:47.928211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1804e2a3-5e31-4a20-99e1-4077f842f7d9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:47.928931 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-1804e2a3-5e31-4a20-99e1-4077f842f7d9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:47.935822 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1804e2a3-5e31-4a20-99e1-4077f842f7d9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:47.936437 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1804e2a3-5e31-4a20-99e1-4077f842f7d9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:47.937085 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1804e2a3-5e31-4a20-99e1-4077f842f7d9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:47.937779 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1804e2a3-5e31-4a20-99e1-4077f842f7d9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:47.938224 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1804e2a3-5e31-4a20-99e1-4077f842f7d9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:47.938828 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1804e2a3-5e31-4a20-99e1-4077f842f7d9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:48.096445 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1804e2a3-5e31-4a20-99e1-4077f842f7d9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:48.104123 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1804e2a3-5e31-4a20-99e1-4077f842f7d9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 200 len: 1314 microversion: 2.1 time: 0.179971 Sep 26 05:38:48.104755 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 563/1105] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:47 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:49.126876 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9e263bfb-b9fe-4b03-8628-d1f60f0bc758 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:49.127481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9e263bfb-b9fe-4b03-8628-d1f60f0bc758 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:49.133838 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e263bfb-b9fe-4b03-8628-d1f60f0bc758 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:49.134313 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e263bfb-b9fe-4b03-8628-d1f60f0bc758 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:49.134752 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e263bfb-b9fe-4b03-8628-d1f60f0bc758 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:49.135429 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e263bfb-b9fe-4b03-8628-d1f60f0bc758 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:49.135877 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e263bfb-b9fe-4b03-8628-d1f60f0bc758 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:49.136332 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e263bfb-b9fe-4b03-8628-d1f60f0bc758 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:49.274453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9e263bfb-b9fe-4b03-8628-d1f60f0bc758 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:49.283145 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9e263bfb-b9fe-4b03-8628-d1f60f0bc758 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 200 len: 1314 microversion: 2.1 time: 0.159982 Sep 26 05:38:49.283719 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 543/1106] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:49 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:50.305876 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c26f9a45-3c5d-4ee3-8f20-1d46d837b9e4 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:50.306512 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c26f9a45-3c5d-4ee3-8f20-1d46d837b9e4 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:50.313099 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c26f9a45-3c5d-4ee3-8f20-1d46d837b9e4 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:50.313582 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c26f9a45-3c5d-4ee3-8f20-1d46d837b9e4 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:50.314011 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c26f9a45-3c5d-4ee3-8f20-1d46d837b9e4 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:50.314699 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c26f9a45-3c5d-4ee3-8f20-1d46d837b9e4 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:50.315145 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c26f9a45-3c5d-4ee3-8f20-1d46d837b9e4 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:50.315560 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c26f9a45-3c5d-4ee3-8f20-1d46d837b9e4 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:50.449048 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-c26f9a45-3c5d-4ee3-8f20-1d46d837b9e4 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:50.457504 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c26f9a45-3c5d-4ee3-8f20-1d46d837b9e4 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 200 len: 1314 microversion: 2.1 time: 0.155525 Sep 26 05:38:50.458056 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 564/1107] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:50 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:51.481589 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3a82e46b-34b6-416f-a4c2-2470ae8a507b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:51.482223 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3a82e46b-34b6-416f-a4c2-2470ae8a507b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:51.488802 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a82e46b-34b6-416f-a4c2-2470ae8a507b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:51.489294 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a82e46b-34b6-416f-a4c2-2470ae8a507b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:51.489734 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a82e46b-34b6-416f-a4c2-2470ae8a507b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:51.490435 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a82e46b-34b6-416f-a4c2-2470ae8a507b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:51.490893 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a82e46b-34b6-416f-a4c2-2470ae8a507b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:51.491324 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a82e46b-34b6-416f-a4c2-2470ae8a507b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:51.619207 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3a82e46b-34b6-416f-a4c2-2470ae8a507b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:51.627439 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3a82e46b-34b6-416f-a4c2-2470ae8a507b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 200 len: 1314 microversion: 2.1 time: 0.149921 Sep 26 05:38:51.627999 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 544/1108] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:51 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:52.650732 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-0c7a2535-5519-4f1d-af43-c3d8c315536c tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:52.651276 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-0c7a2535-5519-4f1d-af43-c3d8c315536c tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:52.654284 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:52.655017 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=6 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:52.661209 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c7a2535-5519-4f1d-af43-c3d8c315536c tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:52.661697 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c7a2535-5519-4f1d-af43-c3d8c315536c tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:52.662129 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c7a2535-5519-4f1d-af43-c3d8c315536c tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:52.662812 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c7a2535-5519-4f1d-af43-c3d8c315536c tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:52.663268 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c7a2535-5519-4f1d-af43-c3d8c315536c tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:52.663694 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-0c7a2535-5519-4f1d-af43-c3d8c315536c tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:52.793208 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-0c7a2535-5519-4f1d-af43-c3d8c315536c tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:52.800796 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-0c7a2535-5519-4f1d-af43-c3d8c315536c tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 200 len: 1314 microversion: 2.1 time: 0.153991 Sep 26 05:38:52.801359 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 565/1109] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:52 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:53.823073 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-804ce042-eaff-458f-8837-ae579bee57c0 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:53.823680 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-804ce042-eaff-458f-8837-ae579bee57c0 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:53.826187 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:53.831702 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-804ce042-eaff-458f-8837-ae579bee57c0 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:53.832184 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-804ce042-eaff-458f-8837-ae579bee57c0 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:53.832674 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-804ce042-eaff-458f-8837-ae579bee57c0 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:53.833356 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-804ce042-eaff-458f-8837-ae579bee57c0 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:53.833807 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-804ce042-eaff-458f-8837-ae579bee57c0 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:53.834228 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-804ce042-eaff-458f-8837-ae579bee57c0 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:53.960454 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-804ce042-eaff-458f-8837-ae579bee57c0 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:53.968808 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-804ce042-eaff-458f-8837-ae579bee57c0 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 200 len: 1314 microversion: 2.1 time: 0.149405 Sep 26 05:38:53.969643 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 545/1110] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:53 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:54.441285 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-940aec89-81e5-4b7a-b802-5cd06a76bf03 req-23acc5a2-fbb4-4dc8-ad0e-49b41c7fa5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e110bd9-f6bc-409e-beb6-2795aebc59f9", "name": "network-vif-plugged", "status": "completed", "tag": "e8eec1dd-e7cd-4910-b584-d07e93b3bb08"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:38:54.453733 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-940aec89-81e5-4b7a-b802-5cd06a76bf03 req-23acc5a2-fbb4-4dc8-ad0e-49b41c7fa5b8 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:54.454606 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-940aec89-81e5-4b7a-b802-5cd06a76bf03 req-23acc5a2-fbb4-4dc8-ad0e-49b41c7fa5b8 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:54.455042 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-940aec89-81e5-4b7a-b802-5cd06a76bf03 req-23acc5a2-fbb4-4dc8-ad0e-49b41c7fa5b8 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:54.470765 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-940aec89-81e5-4b7a-b802-5cd06a76bf03 req-23acc5a2-fbb4-4dc8-ad0e-49b41c7fa5b8 service nova] Creating event network-vif-plugged:e8eec1dd-e7cd-4910-b584-d07e93b3bb08 for instance 1e110bd9-f6bc-409e-beb6-2795aebc59f9 on hv-cinder-85918 Sep 26 05:38:54.475624 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-940aec89-81e5-4b7a-b802-5cd06a76bf03 req-23acc5a2-fbb4-4dc8-ad0e-49b41c7fa5b8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038934 Sep 26 05:38:54.476555 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 566/1111] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:38:54.992219 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2c1607f3-1e2a-465b-b67f-0e7294f75d25 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:54.992841 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2c1607f3-1e2a-465b-b67f-0e7294f75d25 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:54.999886 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c1607f3-1e2a-465b-b67f-0e7294f75d25 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:55.000391 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c1607f3-1e2a-465b-b67f-0e7294f75d25 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:55.000892 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c1607f3-1e2a-465b-b67f-0e7294f75d25 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:55.001575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c1607f3-1e2a-465b-b67f-0e7294f75d25 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:55.002023 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c1607f3-1e2a-465b-b67f-0e7294f75d25 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:55.002443 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c1607f3-1e2a-465b-b67f-0e7294f75d25 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:55.137403 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2c1607f3-1e2a-465b-b67f-0e7294f75d25 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:55.145693 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2c1607f3-1e2a-465b-b67f-0e7294f75d25 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 200 len: 1314 microversion: 2.1 time: 0.157341 Sep 26 05:38:55.146255 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 546/1112] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:54 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:56.169593 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-c220e5a6-4af8-4151-9a47-66aca70fd0fa tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:56.170386 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-c220e5a6-4af8-4151-9a47-66aca70fd0fa tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:56.172330 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:56.178619 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c220e5a6-4af8-4151-9a47-66aca70fd0fa tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:56.179106 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c220e5a6-4af8-4151-9a47-66aca70fd0fa tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:56.179542 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c220e5a6-4af8-4151-9a47-66aca70fd0fa tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:56.180232 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c220e5a6-4af8-4151-9a47-66aca70fd0fa tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:56.180711 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c220e5a6-4af8-4151-9a47-66aca70fd0fa tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:56.181141 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-c220e5a6-4af8-4151-9a47-66aca70fd0fa tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:56.203379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:56.326354 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-c220e5a6-4af8-4151-9a47-66aca70fd0fa tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:56.334148 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-c220e5a6-4af8-4151-9a47-66aca70fd0fa tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 200 len: 1314 microversion: 2.1 time: 0.169241 Sep 26 05:38:56.334707 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 567/1113] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:56 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:57.357596 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-12559984-56f0-499a-b9a1-47e934519a1a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:57.358216 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-12559984-56f0-499a-b9a1-47e934519a1a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:57.364791 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12559984-56f0-499a-b9a1-47e934519a1a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:57.365218 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12559984-56f0-499a-b9a1-47e934519a1a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:57.365682 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12559984-56f0-499a-b9a1-47e934519a1a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:57.366373 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12559984-56f0-499a-b9a1-47e934519a1a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:57.366823 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12559984-56f0-499a-b9a1-47e934519a1a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:57.367249 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12559984-56f0-499a-b9a1-47e934519a1a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:57.494839 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-12559984-56f0-499a-b9a1-47e934519a1a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:57.502970 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-12559984-56f0-499a-b9a1-47e934519a1a tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 200 len: 1314 microversion: 2.1 time: 0.149224 Sep 26 05:38:57.503530 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 547/1114] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:57 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:58.526227 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-80760c91-ce53-492e-9902-94d6fd123930 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:58.526840 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-80760c91-ce53-492e-9902-94d6fd123930 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:58.533985 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-80760c91-ce53-492e-9902-94d6fd123930 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:58.534464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-80760c91-ce53-492e-9902-94d6fd123930 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:58.534893 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-80760c91-ce53-492e-9902-94d6fd123930 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:58.535571 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-80760c91-ce53-492e-9902-94d6fd123930 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:58.536016 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-80760c91-ce53-492e-9902-94d6fd123930 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:58.536461 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-80760c91-ce53-492e-9902-94d6fd123930 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:58.672712 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-80760c91-ce53-492e-9902-94d6fd123930 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:58.680208 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-80760c91-ce53-492e-9902-94d6fd123930 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 200 len: 1314 microversion: 2.1 time: 0.157884 Sep 26 05:38:58.680788 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 568/1115] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:58 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:59.702469 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-13eceeff-6832-44b5-abdb-e75b5256afa3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:59.703085 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-13eceeff-6832-44b5-abdb-e75b5256afa3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:38:59.709713 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-13eceeff-6832-44b5-abdb-e75b5256afa3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:59.710199 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-13eceeff-6832-44b5-abdb-e75b5256afa3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:59.710636 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-13eceeff-6832-44b5-abdb-e75b5256afa3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:59.711354 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-13eceeff-6832-44b5-abdb-e75b5256afa3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:38:59.711835 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-13eceeff-6832-44b5-abdb-e75b5256afa3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:38:59.712278 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-13eceeff-6832-44b5-abdb-e75b5256afa3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:38:59.837691 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-13eceeff-6832-44b5-abdb-e75b5256afa3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:38:59.846331 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-13eceeff-6832-44b5-abdb-e75b5256afa3 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 200 len: 1499 microversion: 2.1 time: 0.147761 Sep 26 05:38:59.846887 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 548/1116] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:38:59 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 1499 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:00.236410 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-fbcdbacc-cef0-4817-932b-581f0bff373c tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:39:00.238771 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-fbcdbacc-cef0-4817-932b-581f0bff373c tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:00.245107 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fbcdbacc-cef0-4817-932b-581f0bff373c tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:00.245637 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fbcdbacc-cef0-4817-932b-581f0bff373c tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:00.246079 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fbcdbacc-cef0-4817-932b-581f0bff373c tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:00.246856 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fbcdbacc-cef0-4817-932b-581f0bff373c tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:00.247339 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fbcdbacc-cef0-4817-932b-581f0bff373c tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:00.247762 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fbcdbacc-cef0-4817-932b-581f0bff373c tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:00.323676 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-fbcdbacc-cef0-4817-932b-581f0bff373c tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "POST /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac/action" status: 202 len: 0 microversion: 2.1 time: 0.090967 Sep 26 05:39:00.327871 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 569/1117] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 05:39:00 2022] POST /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:39:00.333644 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2c2fa2fe-3145-455e-9898-a85942507143 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:00.334509 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2c2fa2fe-3145-455e-9898-a85942507143 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:00.341163 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c2fa2fe-3145-455e-9898-a85942507143 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:00.341723 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c2fa2fe-3145-455e-9898-a85942507143 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:00.342392 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c2fa2fe-3145-455e-9898-a85942507143 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:00.343945 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c2fa2fe-3145-455e-9898-a85942507143 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:00.344858 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c2fa2fe-3145-455e-9898-a85942507143 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:00.345333 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c2fa2fe-3145-455e-9898-a85942507143 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:00.347626 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9cccb435-0b65-4825-be18-0a4f24ba45b9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:00.348270 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-9cccb435-0b65-4825-be18-0a4f24ba45b9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:00.355383 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9cccb435-0b65-4825-be18-0a4f24ba45b9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:00.355502 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9cccb435-0b65-4825-be18-0a4f24ba45b9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:00.355888 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9cccb435-0b65-4825-be18-0a4f24ba45b9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:00.356727 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9cccb435-0b65-4825-be18-0a4f24ba45b9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:00.357308 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9cccb435-0b65-4825-be18-0a4f24ba45b9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:00.357774 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9cccb435-0b65-4825-be18-0a4f24ba45b9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:00.385358 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-9cccb435-0b65-4825-be18-0a4f24ba45b9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Going to try to terminate instance {{(pid=120806) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:39:00.492629 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-9cccb435-0b65-4825-be18-0a4f24ba45b9 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 204 len: 0 microversion: 2.1 time: 0.149997 Sep 26 05:39:00.493204 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 570/1118] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:39:00 2022] DELETE /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 05:39:00.503249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-cfec5324-cce4-47f1-97a9-3f2f0af3b3ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:00.504221 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-cfec5324-cce4-47f1-97a9-3f2f0af3b3ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:00.510641 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cfec5324-cce4-47f1-97a9-3f2f0af3b3ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:00.511114 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cfec5324-cce4-47f1-97a9-3f2f0af3b3ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:00.511617 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cfec5324-cce4-47f1-97a9-3f2f0af3b3ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:00.512457 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cfec5324-cce4-47f1-97a9-3f2f0af3b3ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:00.512957 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cfec5324-cce4-47f1-97a9-3f2f0af3b3ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:00.513410 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-cfec5324-cce4-47f1-97a9-3f2f0af3b3ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:00.549275 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2c2fa2fe-3145-455e-9898-a85942507143 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:00.559657 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2c2fa2fe-3145-455e-9898-a85942507143 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1750 microversion: 2.1 time: 0.230108 Sep 26 05:39:00.560217 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 549/1119] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:00 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1750 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:00.661267 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-cfec5324-cce4-47f1-97a9-3f2f0af3b3ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:00.669010 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-cfec5324-cce4-47f1-97a9-3f2f0af3b3ff tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 200 len: 1505 microversion: 2.1 time: 0.171139 Sep 26 05:39:00.669561 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 571/1120] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:00 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:01.586200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5a2b5524-95a6-4340-8bf8-f7b0eca93372 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:01.586819 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5a2b5524-95a6-4340-8bf8-f7b0eca93372 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:01.593413 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a2b5524-95a6-4340-8bf8-f7b0eca93372 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:01.593901 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a2b5524-95a6-4340-8bf8-f7b0eca93372 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:01.594597 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a2b5524-95a6-4340-8bf8-f7b0eca93372 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:01.595292 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a2b5524-95a6-4340-8bf8-f7b0eca93372 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:01.595750 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a2b5524-95a6-4340-8bf8-f7b0eca93372 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:01.596177 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a2b5524-95a6-4340-8bf8-f7b0eca93372 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:01.600081 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=84 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:01.693351 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1a55b18a-5d8b-45b0-9c32-e82fce216e72 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:01.694119 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-1a55b18a-5d8b-45b0-9c32-e82fce216e72 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:01.700897 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1a55b18a-5d8b-45b0-9c32-e82fce216e72 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:01.701392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1a55b18a-5d8b-45b0-9c32-e82fce216e72 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:01.701999 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1a55b18a-5d8b-45b0-9c32-e82fce216e72 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:01.703157 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1a55b18a-5d8b-45b0-9c32-e82fce216e72 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:01.703694 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1a55b18a-5d8b-45b0-9c32-e82fce216e72 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:01.704199 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-1a55b18a-5d8b-45b0-9c32-e82fce216e72 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:01.768916 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5a2b5524-95a6-4340-8bf8-f7b0eca93372 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:01.778006 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5a2b5524-95a6-4340-8bf8-f7b0eca93372 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1750 microversion: 2.1 time: 0.195646 Sep 26 05:39:01.778848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 550/1121] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:01 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1750 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:39:01.855518 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1a55b18a-5d8b-45b0-9c32-e82fce216e72 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:01.864638 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1a55b18a-5d8b-45b0-9c32-e82fce216e72 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 200 len: 1505 microversion: 2.1 time: 0.174946 Sep 26 05:39:01.865207 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 572/1122] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:01 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:39:02.804504 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a9b4178d-ebf4-42a2-bc14-37bd20a1ca45 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:02.805666 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a9b4178d-ebf4-42a2-bc14-37bd20a1ca45 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:02.812450 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a9b4178d-ebf4-42a2-bc14-37bd20a1ca45 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:02.812937 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a9b4178d-ebf4-42a2-bc14-37bd20a1ca45 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:02.813371 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a9b4178d-ebf4-42a2-bc14-37bd20a1ca45 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:02.814232 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a9b4178d-ebf4-42a2-bc14-37bd20a1ca45 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:02.814682 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a9b4178d-ebf4-42a2-bc14-37bd20a1ca45 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:02.815108 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a9b4178d-ebf4-42a2-bc14-37bd20a1ca45 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:02.867424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-e7d7fdfe-4b02-4868-aed4-1441d045b6e4 req-c4962764-539a-4c03-8280-69ca856b414e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e110bd9-f6bc-409e-beb6-2795aebc59f9", "name": "network-vif-deleted", "tag": "e8eec1dd-e7cd-4910-b584-d07e93b3bb08"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:39:02.880177 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-e7d7fdfe-4b02-4868-aed4-1441d045b6e4 req-c4962764-539a-4c03-8280-69ca856b414e service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:02.880707 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-e7d7fdfe-4b02-4868-aed4-1441d045b6e4 req-c4962764-539a-4c03-8280-69ca856b414e service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:02.881121 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-e7d7fdfe-4b02-4868-aed4-1441d045b6e4 req-c4962764-539a-4c03-8280-69ca856b414e service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:02.907246 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-e7d7fdfe-4b02-4868-aed4-1441d045b6e4 req-c4962764-539a-4c03-8280-69ca856b414e service nova] Creating event network-vif-deleted:e8eec1dd-e7cd-4910-b584-d07e93b3bb08 for instance 1e110bd9-f6bc-409e-beb6-2795aebc59f9 on hv-cinder-85918 Sep 26 05:39:02.912942 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-e7d7fdfe-4b02-4868-aed4-1441d045b6e4 req-c4962764-539a-4c03-8280-69ca856b414e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054891 Sep 26 05:39:02.914176 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 573/1123] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:39:02.921543 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b6159c90-6c6a-4fe9-9689-c76ee663c420 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:02.923499 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b6159c90-6c6a-4fe9-9689-c76ee663c420 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:02.931546 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b6159c90-6c6a-4fe9-9689-c76ee663c420 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:02.932461 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b6159c90-6c6a-4fe9-9689-c76ee663c420 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:02.933567 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b6159c90-6c6a-4fe9-9689-c76ee663c420 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:02.934519 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b6159c90-6c6a-4fe9-9689-c76ee663c420 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:02.935151 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b6159c90-6c6a-4fe9-9689-c76ee663c420 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:02.935735 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b6159c90-6c6a-4fe9-9689-c76ee663c420 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:03.025694 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b6159c90-6c6a-4fe9-9689-c76ee663c420 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ff402e4f74abaae63a8230885827b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fd985226b460a93af30e55719aab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:03.032573 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a9b4178d-ebf4-42a2-bc14-37bd20a1ca45 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:03.038163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b6159c90-6c6a-4fe9-9689-c76ee663c420 tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 200 len: 1299 microversion: 2.1 time: 0.122494 Sep 26 05:39:03.038816 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 574/1124] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:02 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 1299 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:03.043784 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a9b4178d-ebf4-42a2-bc14-37bd20a1ca45 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1755 microversion: 2.1 time: 0.244240 Sep 26 05:39:03.044480 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 551/1125] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:02 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1755 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:04.060932 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b60520ee-4ac6-453a-a8a1-1386fd2db80b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:04.062249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b60520ee-4ac6-453a-a8a1-1386fd2db80b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] [instance: 1e110bd9-f6bc-409e-beb6-2795aebc59f9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:04.068306 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0d0f0b09-f938-43e3-9cfd-26931187ab50 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:04.068761 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b60520ee-4ac6-453a-a8a1-1386fd2db80b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:04.068926 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0d0f0b09-f938-43e3-9cfd-26931187ab50 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:04.069231 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b60520ee-4ac6-453a-a8a1-1386fd2db80b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:04.069658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b60520ee-4ac6-453a-a8a1-1386fd2db80b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:04.070345 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b60520ee-4ac6-453a-a8a1-1386fd2db80b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:04.070788 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b60520ee-4ac6-453a-a8a1-1386fd2db80b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:04.071212 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b60520ee-4ac6-453a-a8a1-1386fd2db80b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:04.075262 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0d0f0b09-f938-43e3-9cfd-26931187ab50 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:04.075749 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0d0f0b09-f938-43e3-9cfd-26931187ab50 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:04.076188 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0d0f0b09-f938-43e3-9cfd-26931187ab50 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:04.076967 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0d0f0b09-f938-43e3-9cfd-26931187ab50 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:04.077708 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0d0f0b09-f938-43e3-9cfd-26931187ab50 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:04.078143 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0d0f0b09-f938-43e3-9cfd-26931187ab50 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:04.084571 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-b60520ee-4ac6-453a-a8a1-1386fd2db80b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] HTTP exception thrown: Instance 1e110bd9-f6bc-409e-beb6-2795aebc59f9 could not be found. Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b60520ee-4ac6-453a-a8a1-1386fd2db80b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Request method failure captured: Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 HTTP/1.1 Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTrRDd7cdh6Z8TyeaZAmWLoGEzkQr---TcevVFpPT4j5bHVaBGU1gsE38CbgsSSwUn1xfLc3S4MskR1CRXK2PwUweQKew2nWeA9EBU972sqZM0rNeihVI7bxDTfZXS4nYKW3EK66Fjej6tO6qJXi2q6zAG8qKvHrm2jBdtLPYuOIOYc Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: 741fd985226b460a93af30e55719aab2 Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-VolumesActionsTest-541034204 Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:39:04.086399 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:39:04.088161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/741fd985226b460a93af30e55719aab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/741fd985226b460a93af30e55719aab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/741fd985226b460a93af30e55719aab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_741fd985226b460a93af30e55719aab2"}]}] Sep 26 05:39:04.088161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-VolumesActionsTest-541034204 Sep 26 05:39:04.088161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: 741fd985226b460a93af30e55719aab2 Sep 26 05:39:04.088161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-VolumesActionsTest-541034204 Sep 26 05:39:04.088161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-VolumesActionsTest-541034204-project Sep 26 05:39:04.088161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:39:04.088161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:39:04.088161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: e40ff402e4f74abaae63a8230885827b Sep 26 05:39:04.088161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-VolumesActionsTest-541034204-project Sep 26 05:39:04.088161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:39:04.088161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance 1e110bd9-f6bc-409e-beb6-2795aebc59f9 could not be found. Sep 26 05:39:04.088161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': '1e110bd9-f6bc-409e-beb6-2795aebc59f9'} Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e110bd9-f6bc-409e-beb6-2795aebc59f9 could not be found. Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:39:04.089170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:39:04.090797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:39:04.090797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:39:04.090797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:39:04.090797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:39:04.090797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:39:04.090797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:39:04.090797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:39:04.090797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e110bd9-f6bc-409e-beb6-2795aebc59f9 could not be found. Sep 26 05:39:04.090797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:39:04.090797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:39:04.090797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:39:04.090797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:39:04.090797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:39:04.090797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:39:04.090797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:39:04.090797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:39:04.090797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e110bd9-f6bc-409e-beb6-2795aebc59f9 could not be found. Sep 26 05:39:04.090797 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:39:04.092292 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b60520ee-4ac6-453a-a8a1-1386fd2db80b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] Returning 404 to user: Instance 1e110bd9-f6bc-409e-beb6-2795aebc59f9 could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:39:04.092292 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b60520ee-4ac6-453a-a8a1-1386fd2db80b tempest-VolumesActionsTest-541034204 tempest-VolumesActionsTest-541034204-project] 10.222.0.49 "GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9" status: 404 len: 111 microversion: 2.1 time: 0.030721 Sep 26 05:39:04.092292 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 575/1126] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:04 2022] GET /compute/v2.1/servers/1e110bd9-f6bc-409e-beb6-2795aebc59f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:39:04.237474 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0d0f0b09-f938-43e3-9cfd-26931187ab50 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:04.245906 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0d0f0b09-f938-43e3-9cfd-26931187ab50 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1755 microversion: 2.1 time: 0.181433 Sep 26 05:39:04.247375 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 552/1127] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:04 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:39:05.271192 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5ac3a3c2-7a56-4e27-b439-17fb09dc0f95 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:05.271810 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5ac3a3c2-7a56-4e27-b439-17fb09dc0f95 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:05.277818 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ac3a3c2-7a56-4e27-b439-17fb09dc0f95 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:05.278299 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ac3a3c2-7a56-4e27-b439-17fb09dc0f95 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:05.278737 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ac3a3c2-7a56-4e27-b439-17fb09dc0f95 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:05.279461 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ac3a3c2-7a56-4e27-b439-17fb09dc0f95 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:05.279987 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ac3a3c2-7a56-4e27-b439-17fb09dc0f95 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:05.280609 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5ac3a3c2-7a56-4e27-b439-17fb09dc0f95 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:05.430814 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5ac3a3c2-7a56-4e27-b439-17fb09dc0f95 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:05.439709 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5ac3a3c2-7a56-4e27-b439-17fb09dc0f95 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1755 microversion: 2.1 time: 0.172663 Sep 26 05:39:05.440299 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 576/1128] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:05 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:06.462810 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d643783c-d6f9-4a52-aac5-bd208ead7971 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:06.463429 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d643783c-d6f9-4a52-aac5-bd208ead7971 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:06.470480 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d643783c-d6f9-4a52-aac5-bd208ead7971 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:06.470991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d643783c-d6f9-4a52-aac5-bd208ead7971 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:06.471536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d643783c-d6f9-4a52-aac5-bd208ead7971 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:06.472238 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d643783c-d6f9-4a52-aac5-bd208ead7971 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:06.472745 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d643783c-d6f9-4a52-aac5-bd208ead7971 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:06.473173 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d643783c-d6f9-4a52-aac5-bd208ead7971 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:06.620622 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d643783c-d6f9-4a52-aac5-bd208ead7971 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:06.629798 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d643783c-d6f9-4a52-aac5-bd208ead7971 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1755 microversion: 2.1 time: 0.170754 Sep 26 05:39:06.630378 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 553/1129] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:06 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:07.652923 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-92efae92-0c88-49b5-80de-dc754d53602d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:07.653545 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-92efae92-0c88-49b5-80de-dc754d53602d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:07.660214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92efae92-0c88-49b5-80de-dc754d53602d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:07.660751 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92efae92-0c88-49b5-80de-dc754d53602d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:07.661181 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92efae92-0c88-49b5-80de-dc754d53602d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:07.661867 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92efae92-0c88-49b5-80de-dc754d53602d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:07.662313 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92efae92-0c88-49b5-80de-dc754d53602d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:07.662757 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-92efae92-0c88-49b5-80de-dc754d53602d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:07.802433 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-92efae92-0c88-49b5-80de-dc754d53602d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:07.810523 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-92efae92-0c88-49b5-80de-dc754d53602d tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1755 microversion: 2.1 time: 0.161438 Sep 26 05:39:07.811783 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 577/1130] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:07 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:08.833873 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f53c7802-0ee2-4e82-a327-524de1694eab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:08.834515 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f53c7802-0ee2-4e82-a327-524de1694eab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:08.840894 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f53c7802-0ee2-4e82-a327-524de1694eab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:08.841376 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f53c7802-0ee2-4e82-a327-524de1694eab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:08.841807 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f53c7802-0ee2-4e82-a327-524de1694eab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:08.842660 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f53c7802-0ee2-4e82-a327-524de1694eab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:08.843117 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f53c7802-0ee2-4e82-a327-524de1694eab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:08.843536 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f53c7802-0ee2-4e82-a327-524de1694eab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:09.164351 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f53c7802-0ee2-4e82-a327-524de1694eab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:09.173137 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f53c7802-0ee2-4e82-a327-524de1694eab tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1755 microversion: 2.1 time: 0.343086 Sep 26 05:39:09.173699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 554/1131] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:08 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1755 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:10.197624 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3422fead-bff3-4673-b040-f7844d66ebe5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:10.198347 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-3422fead-bff3-4673-b040-f7844d66ebe5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:10.204817 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3422fead-bff3-4673-b040-f7844d66ebe5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:10.205420 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3422fead-bff3-4673-b040-f7844d66ebe5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:10.205979 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3422fead-bff3-4673-b040-f7844d66ebe5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:10.206683 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3422fead-bff3-4673-b040-f7844d66ebe5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:10.207135 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3422fead-bff3-4673-b040-f7844d66ebe5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:10.207565 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3422fead-bff3-4673-b040-f7844d66ebe5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:10.417956 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-3422fead-bff3-4673-b040-f7844d66ebe5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:10.426584 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-3422fead-bff3-4673-b040-f7844d66ebe5 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1755 microversion: 2.1 time: 0.233033 Sep 26 05:39:10.427376 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 578/1132] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:10 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1755 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:11.451075 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4c1357ed-0f1f-48b6-8c89-a216a393a2b3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:11.452413 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4c1357ed-0f1f-48b6-8c89-a216a393a2b3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:11.460623 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c1357ed-0f1f-48b6-8c89-a216a393a2b3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:11.461330 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c1357ed-0f1f-48b6-8c89-a216a393a2b3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:11.462457 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c1357ed-0f1f-48b6-8c89-a216a393a2b3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:11.463338 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c1357ed-0f1f-48b6-8c89-a216a393a2b3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:11.463966 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c1357ed-0f1f-48b6-8c89-a216a393a2b3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:11.464825 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c1357ed-0f1f-48b6-8c89-a216a393a2b3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:11.640280 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4c1357ed-0f1f-48b6-8c89-a216a393a2b3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:11.650111 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4c1357ed-0f1f-48b6-8c89-a216a393a2b3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1755 microversion: 2.1 time: 0.202962 Sep 26 05:39:11.650839 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 555/1133] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:11 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1755 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:12.676704 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-2ef138c9-0a09-4865-922c-241e40621eb2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:12.680518 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-2ef138c9-0a09-4865-922c-241e40621eb2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:12.695254 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2ef138c9-0a09-4865-922c-241e40621eb2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:12.696662 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2ef138c9-0a09-4865-922c-241e40621eb2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:12.697909 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2ef138c9-0a09-4865-922c-241e40621eb2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:12.699965 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2ef138c9-0a09-4865-922c-241e40621eb2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:12.702425 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2ef138c9-0a09-4865-922c-241e40621eb2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:12.703537 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2ef138c9-0a09-4865-922c-241e40621eb2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:12.890685 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2ef138c9-0a09-4865-922c-241e40621eb2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:12.901741 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2ef138c9-0a09-4865-922c-241e40621eb2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1755 microversion: 2.1 time: 0.230776 Sep 26 05:39:12.902569 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 579/1134] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:12 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1755 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:13.938419 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4b6a3c65-1b96-4126-8597-07e338052f1a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:13.939605 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4b6a3c65-1b96-4126-8597-07e338052f1a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:13.946081 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=34 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:13.948121 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c65-1b96-4126-8597-07e338052f1a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:13.948824 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c65-1b96-4126-8597-07e338052f1a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:13.949405 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c65-1b96-4126-8597-07e338052f1a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:13.950350 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c65-1b96-4126-8597-07e338052f1a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:13.950858 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c65-1b96-4126-8597-07e338052f1a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:13.951633 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c65-1b96-4126-8597-07e338052f1a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:14.162819 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4b6a3c65-1b96-4126-8597-07e338052f1a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:14.176712 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4b6a3c65-1b96-4126-8597-07e338052f1a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1755 microversion: 2.1 time: 0.249283 Sep 26 05:39:14.181973 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 556/1135] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:13 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1755 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:15.215582 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-758f8c92-8422-4f98-b8c0-1490978c526a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:15.216839 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-758f8c92-8422-4f98-b8c0-1490978c526a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:15.230029 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-758f8c92-8422-4f98-b8c0-1490978c526a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:15.230635 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-758f8c92-8422-4f98-b8c0-1490978c526a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:15.231077 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-758f8c92-8422-4f98-b8c0-1490978c526a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:15.232542 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-758f8c92-8422-4f98-b8c0-1490978c526a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:15.233621 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-758f8c92-8422-4f98-b8c0-1490978c526a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:15.234168 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-758f8c92-8422-4f98-b8c0-1490978c526a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:15.417891 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-758f8c92-8422-4f98-b8c0-1490978c526a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:15.427629 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-758f8c92-8422-4f98-b8c0-1490978c526a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1755 microversion: 2.1 time: 0.217398 Sep 26 05:39:15.432774 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 580/1136] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:15 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1755 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:16.451716 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-22db6c9e-0bc1-4e5f-837f-869b795b5fe9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:16.453193 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-22db6c9e-0bc1-4e5f-837f-869b795b5fe9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:16.460853 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22db6c9e-0bc1-4e5f-837f-869b795b5fe9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:16.461599 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22db6c9e-0bc1-4e5f-837f-869b795b5fe9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:16.462142 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22db6c9e-0bc1-4e5f-837f-869b795b5fe9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:16.462969 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22db6c9e-0bc1-4e5f-837f-869b795b5fe9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:16.463531 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22db6c9e-0bc1-4e5f-837f-869b795b5fe9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:16.464227 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22db6c9e-0bc1-4e5f-837f-869b795b5fe9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:16.628891 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-22db6c9e-0bc1-4e5f-837f-869b795b5fe9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:16.637902 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-22db6c9e-0bc1-4e5f-837f-869b795b5fe9 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1755 microversion: 2.1 time: 0.190065 Sep 26 05:39:16.644130 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 557/1137] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:16 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1755 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:17.664879 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f8441926-3c28-4707-bc2c-66a07a829c98 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:17.665880 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f8441926-3c28-4707-bc2c-66a07a829c98 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:17.675313 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f8441926-3c28-4707-bc2c-66a07a829c98 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:17.675831 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f8441926-3c28-4707-bc2c-66a07a829c98 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:17.676290 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f8441926-3c28-4707-bc2c-66a07a829c98 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:17.677025 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f8441926-3c28-4707-bc2c-66a07a829c98 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:17.677457 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f8441926-3c28-4707-bc2c-66a07a829c98 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:17.677905 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f8441926-3c28-4707-bc2c-66a07a829c98 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:17.847596 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-f8441926-3c28-4707-bc2c-66a07a829c98 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:17.857221 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f8441926-3c28-4707-bc2c-66a07a829c98 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1755 microversion: 2.1 time: 0.196639 Sep 26 05:39:17.858765 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 581/1138] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:17 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1755 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:18.886783 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f6cd0c9b-22d4-4440-8156-8b665f357f1b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:18.887466 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f6cd0c9b-22d4-4440-8156-8b665f357f1b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:18.897338 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f6cd0c9b-22d4-4440-8156-8b665f357f1b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:18.897830 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f6cd0c9b-22d4-4440-8156-8b665f357f1b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:18.898471 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f6cd0c9b-22d4-4440-8156-8b665f357f1b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:18.899224 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f6cd0c9b-22d4-4440-8156-8b665f357f1b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:18.899684 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f6cd0c9b-22d4-4440-8156-8b665f357f1b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:18.900113 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f6cd0c9b-22d4-4440-8156-8b665f357f1b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:19.071353 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f6cd0c9b-22d4-4440-8156-8b665f357f1b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:19.080822 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f6cd0c9b-22d4-4440-8156-8b665f357f1b tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1755 microversion: 2.1 time: 0.198702 Sep 26 05:39:19.081840 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 558/1139] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:18 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1755 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:20.114634 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9033090e-ccb5-418f-93d0-63e95328bd1e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:20.115658 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-9033090e-ccb5-418f-93d0-63e95328bd1e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:20.133320 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9033090e-ccb5-418f-93d0-63e95328bd1e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:20.133782 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9033090e-ccb5-418f-93d0-63e95328bd1e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:20.134253 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9033090e-ccb5-418f-93d0-63e95328bd1e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:20.135308 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9033090e-ccb5-418f-93d0-63e95328bd1e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:20.136034 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9033090e-ccb5-418f-93d0-63e95328bd1e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:20.136746 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9033090e-ccb5-418f-93d0-63e95328bd1e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:20.337478 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-9033090e-ccb5-418f-93d0-63e95328bd1e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:20.341012 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:20.348367 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-9033090e-ccb5-418f-93d0-63e95328bd1e tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1755 microversion: 2.1 time: 0.246237 Sep 26 05:39:20.348937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 582/1140] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:20 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1755 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:21.372652 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-55535298-c29d-4fa0-b106-9b14591a6eba tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:21.373503 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-55535298-c29d-4fa0-b106-9b14591a6eba tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:21.380062 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-55535298-c29d-4fa0-b106-9b14591a6eba tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:21.380593 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-55535298-c29d-4fa0-b106-9b14591a6eba tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:21.381031 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-55535298-c29d-4fa0-b106-9b14591a6eba tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:21.381730 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-55535298-c29d-4fa0-b106-9b14591a6eba tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:21.382173 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-55535298-c29d-4fa0-b106-9b14591a6eba tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:21.382598 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-55535298-c29d-4fa0-b106-9b14591a6eba tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:21.531627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-55535298-c29d-4fa0-b106-9b14591a6eba tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:21.540011 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-55535298-c29d-4fa0-b106-9b14591a6eba tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1755 microversion: 2.1 time: 0.171416 Sep 26 05:39:21.540995 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 559/1141] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:21 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:22.567217 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b2f8b0bc-9337-4e2f-a7ca-05366077eaf7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:22.568584 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b2f8b0bc-9337-4e2f-a7ca-05366077eaf7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:22.576693 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b2f8b0bc-9337-4e2f-a7ca-05366077eaf7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:22.577622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b2f8b0bc-9337-4e2f-a7ca-05366077eaf7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:22.578348 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b2f8b0bc-9337-4e2f-a7ca-05366077eaf7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:22.579248 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b2f8b0bc-9337-4e2f-a7ca-05366077eaf7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:22.579727 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b2f8b0bc-9337-4e2f-a7ca-05366077eaf7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:22.580221 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b2f8b0bc-9337-4e2f-a7ca-05366077eaf7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:22.741891 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b2f8b0bc-9337-4e2f-a7ca-05366077eaf7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:22.750915 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b2f8b0bc-9337-4e2f-a7ca-05366077eaf7 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1755 microversion: 2.1 time: 0.188645 Sep 26 05:39:22.751683 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 583/1142] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:22 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:23.775205 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ce4f5c5e-21e7-494c-99d7-f9e3810205aa tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:23.776110 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ce4f5c5e-21e7-494c-99d7-f9e3810205aa tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:23.788236 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ce4f5c5e-21e7-494c-99d7-f9e3810205aa tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:23.789008 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ce4f5c5e-21e7-494c-99d7-f9e3810205aa tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:23.789681 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ce4f5c5e-21e7-494c-99d7-f9e3810205aa tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:23.790620 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ce4f5c5e-21e7-494c-99d7-f9e3810205aa tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:23.791297 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ce4f5c5e-21e7-494c-99d7-f9e3810205aa tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:23.791965 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ce4f5c5e-21e7-494c-99d7-f9e3810205aa tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:23.969453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ce4f5c5e-21e7-494c-99d7-f9e3810205aa tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:23.977983 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ce4f5c5e-21e7-494c-99d7-f9e3810205aa tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1755 microversion: 2.1 time: 0.206636 Sep 26 05:39:23.978558 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 560/1143] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:23 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1755 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:25.008410 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e7696200-5e06-4acb-8cc7-681a65e8bb6a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:25.009077 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e7696200-5e06-4acb-8cc7-681a65e8bb6a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:25.016838 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e7696200-5e06-4acb-8cc7-681a65e8bb6a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:25.017654 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e7696200-5e06-4acb-8cc7-681a65e8bb6a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:25.018104 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e7696200-5e06-4acb-8cc7-681a65e8bb6a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:25.019301 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e7696200-5e06-4acb-8cc7-681a65e8bb6a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:25.019301 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e7696200-5e06-4acb-8cc7-681a65e8bb6a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:25.019732 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e7696200-5e06-4acb-8cc7-681a65e8bb6a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:25.192991 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e7696200-5e06-4acb-8cc7-681a65e8bb6a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:25.205617 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e7696200-5e06-4acb-8cc7-681a65e8bb6a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1758 microversion: 2.1 time: 0.202090 Sep 26 05:39:25.206215 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 584/1144] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:25 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:51.135383 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fff1c39b-6879-4165-8410-0f60299e97d4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1491769875", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-641338499", "security_groups": [{"name": "tempest-secgroup-smoke-1686962999"}], "block_device_mapping_v2": [{"uuid": "786b20cb-f27c-42b7-b514-2b32eda0e691", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa57f4f4-2276-4970-8337-66a125f8a06a"}]}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:39:51.150895 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=9 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:51.151555 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=65 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:51.283005 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-fff1c39b-6879-4165-8410-0f60299e97d4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] validate_networks() for [('aa57f4f4-2276-4970-8337-66a125f8a06a', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:39:51.771800 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-fff1c39b-6879-4165-8410-0f60299e97d4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:39:51.772231 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-fff1c39b-6879-4165-8410-0f60299e97d4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:39:51.772751 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-fff1c39b-6879-4165-8410-0f60299e97d4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:39:51.773166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-fff1c39b-6879-4165-8410-0f60299e97d4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:39:51.773586 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-fff1c39b-6879-4165-8410-0f60299e97d4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:39:51.782790 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fff1c39b-6879-4165-8410-0f60299e97d4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:51.783278 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fff1c39b-6879-4165-8410-0f60299e97d4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:51.783772 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fff1c39b-6879-4165-8410-0f60299e97d4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:51.784494 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fff1c39b-6879-4165-8410-0f60299e97d4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:51.784957 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fff1c39b-6879-4165-8410-0f60299e97d4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:51.785474 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fff1c39b-6879-4165-8410-0f60299e97d4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:51.802796 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-fff1c39b-6879-4165-8410-0f60299e97d4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Getting quotas for project 774c63ee5fc74c619f63c64590c154e4. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:39:51.806829 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-fff1c39b-6879-4165-8410-0f60299e97d4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Getting quotas for user 57daecc890ac421b8eb7b5fb4bf25411 and project 774c63ee5fc74c619f63c64590c154e4. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:39:51.887645 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fff1c39b-6879-4165-8410-0f60299e97d4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:39:51.890262 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fff1c39b-6879-4165-8410-0f60299e97d4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='786b20cb-f27c-42b7-b514-2b32eda0e691',volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:39:52.034632 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fff1c39b-6879-4165-8410-0f60299e97d4 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.903211 Sep 26 05:39:52.035261 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 561/1145] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:39:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:39:52.046679 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-1fea7967-f5ea-4d22-9770-336049189809 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:52.047214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-1fea7967-f5ea-4d22-9770-336049189809 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:52.050457 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 26 05:39:52.051267 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:52.051994 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=12 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:52.106983 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-1fea7967-f5ea-4d22-9770-336049189809 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:52.114515 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-1fea7967-f5ea-4d22-9770-336049189809 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1094 microversion: 2.1 time: 0.071792 Sep 26 05:39:52.115091 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 585/1146] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:52 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:53.142731 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f55c001d-7e00-459a-bcf2-4094c01311a5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:53.142731 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f55c001d-7e00-459a-bcf2-4094c01311a5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:53.146603 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f55c001d-7e00-459a-bcf2-4094c01311a5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:53.147217 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f55c001d-7e00-459a-bcf2-4094c01311a5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:53.147724 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f55c001d-7e00-459a-bcf2-4094c01311a5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:53.148614 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f55c001d-7e00-459a-bcf2-4094c01311a5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:53.149145 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f55c001d-7e00-459a-bcf2-4094c01311a5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:53.149721 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f55c001d-7e00-459a-bcf2-4094c01311a5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:53.221693 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f55c001d-7e00-459a-bcf2-4094c01311a5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:53.230108 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f55c001d-7e00-459a-bcf2-4094c01311a5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1200 microversion: 2.1 time: 0.096856 Sep 26 05:39:53.230855 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 562/1147] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:53 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1200 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:54.255452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b1d1896a-5849-41a2-a5f1-e1f98e1ab762 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:54.256000 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b1d1896a-5849-41a2-a5f1-e1f98e1ab762 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:54.263209 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b1d1896a-5849-41a2-a5f1-e1f98e1ab762 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:54.263686 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b1d1896a-5849-41a2-a5f1-e1f98e1ab762 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:54.264117 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b1d1896a-5849-41a2-a5f1-e1f98e1ab762 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:54.264828 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b1d1896a-5849-41a2-a5f1-e1f98e1ab762 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:54.265279 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b1d1896a-5849-41a2-a5f1-e1f98e1ab762 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:54.265698 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b1d1896a-5849-41a2-a5f1-e1f98e1ab762 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:54.392929 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b1d1896a-5849-41a2-a5f1-e1f98e1ab762 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:54.400854 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b1d1896a-5849-41a2-a5f1-e1f98e1ab762 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1278 microversion: 2.1 time: 0.149804 Sep 26 05:39:54.401416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 586/1148] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:54 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:55.423284 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7187e747-ab19-431c-aa6c-ce2d6b5d333b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:55.424029 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7187e747-ab19-431c-aa6c-ce2d6b5d333b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:55.430382 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7187e747-ab19-431c-aa6c-ce2d6b5d333b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:55.430862 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7187e747-ab19-431c-aa6c-ce2d6b5d333b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:55.431297 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7187e747-ab19-431c-aa6c-ce2d6b5d333b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:55.431974 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7187e747-ab19-431c-aa6c-ce2d6b5d333b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:55.432465 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7187e747-ab19-431c-aa6c-ce2d6b5d333b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:55.432885 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7187e747-ab19-431c-aa6c-ce2d6b5d333b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:55.566795 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7187e747-ab19-431c-aa6c-ce2d6b5d333b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:55.574504 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7187e747-ab19-431c-aa6c-ce2d6b5d333b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1278 microversion: 2.1 time: 0.155106 Sep 26 05:39:55.575070 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 563/1149] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:55 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:56.599021 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-660a5504-0b95-48d0-b3ee-fe58e8bbd95d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:56.599636 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-660a5504-0b95-48d0-b3ee-fe58e8bbd95d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:56.607645 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-660a5504-0b95-48d0-b3ee-fe58e8bbd95d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:56.608214 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-660a5504-0b95-48d0-b3ee-fe58e8bbd95d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:56.608680 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-660a5504-0b95-48d0-b3ee-fe58e8bbd95d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:56.609382 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-660a5504-0b95-48d0-b3ee-fe58e8bbd95d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:56.609983 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-660a5504-0b95-48d0-b3ee-fe58e8bbd95d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:56.610409 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-660a5504-0b95-48d0-b3ee-fe58e8bbd95d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:56.773035 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-660a5504-0b95-48d0-b3ee-fe58e8bbd95d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:56.782980 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-660a5504-0b95-48d0-b3ee-fe58e8bbd95d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1278 microversion: 2.1 time: 0.188837 Sep 26 05:39:56.793944 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 587/1150] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:56 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:56.842367 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-a8267ced-8ee2-4b16-bb3a-629e66f23f6e req-73d17d25-0fb0-45c8-9042-6dba5fef413e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c532b0-9ad5-4519-ad88-2b61859b648f", "tag": "19481f78-5754-457c-8919-13eca736d5eb"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:39:56.855689 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-a8267ced-8ee2-4b16-bb3a-629e66f23f6e req-73d17d25-0fb0-45c8-9042-6dba5fef413e service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:56.856354 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-a8267ced-8ee2-4b16-bb3a-629e66f23f6e req-73d17d25-0fb0-45c8-9042-6dba5fef413e service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:56.856895 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-a8267ced-8ee2-4b16-bb3a-629e66f23f6e req-73d17d25-0fb0-45c8-9042-6dba5fef413e service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:56.870872 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-a8267ced-8ee2-4b16-bb3a-629e66f23f6e req-73d17d25-0fb0-45c8-9042-6dba5fef413e service nova] Creating event network-changed:19481f78-5754-457c-8919-13eca736d5eb for instance 05c532b0-9ad5-4519-ad88-2b61859b648f on hv-cinder-85918 Sep 26 05:39:56.879603 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-a8267ced-8ee2-4b16-bb3a-629e66f23f6e req-73d17d25-0fb0-45c8-9042-6dba5fef413e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041682 Sep 26 05:39:56.880347 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 564/1151] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:39:57.810102 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6e5e403d-f17a-48d8-b429-cffdf2780fdb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:57.810718 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6e5e403d-f17a-48d8-b429-cffdf2780fdb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:57.817918 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6e5e403d-f17a-48d8-b429-cffdf2780fdb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:57.818400 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6e5e403d-f17a-48d8-b429-cffdf2780fdb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:57.818835 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6e5e403d-f17a-48d8-b429-cffdf2780fdb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:57.819524 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6e5e403d-f17a-48d8-b429-cffdf2780fdb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:57.820002 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6e5e403d-f17a-48d8-b429-cffdf2780fdb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:57.820504 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6e5e403d-f17a-48d8-b429-cffdf2780fdb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:57.953993 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6e5e403d-f17a-48d8-b429-cffdf2780fdb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:57.961748 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6e5e403d-f17a-48d8-b429-cffdf2780fdb tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.155665 Sep 26 05:39:57.962318 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 588/1152] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:57 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:39:58.987656 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ed89e3fe-c494-4ab8-bc4b-70eae640f280 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:39:58.988381 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ed89e3fe-c494-4ab8-bc4b-70eae640f280 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:39:58.995113 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ed89e3fe-c494-4ab8-bc4b-70eae640f280 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:58.995593 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ed89e3fe-c494-4ab8-bc4b-70eae640f280 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:58.996025 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ed89e3fe-c494-4ab8-bc4b-70eae640f280 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:58.996747 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ed89e3fe-c494-4ab8-bc4b-70eae640f280 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:39:58.997200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ed89e3fe-c494-4ab8-bc4b-70eae640f280 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:39:58.997623 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ed89e3fe-c494-4ab8-bc4b-70eae640f280 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:39:59.127756 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ed89e3fe-c494-4ab8-bc4b-70eae640f280 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:39:59.135426 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ed89e3fe-c494-4ab8-bc4b-70eae640f280 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.152575 Sep 26 05:39:59.135987 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 565/1153] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:39:58 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:00.158237 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6d3c3292-d85a-4b48-8ab0-beafa96666fc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:00.158852 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6d3c3292-d85a-4b48-8ab0-beafa96666fc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:00.165392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6d3c3292-d85a-4b48-8ab0-beafa96666fc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:00.165867 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6d3c3292-d85a-4b48-8ab0-beafa96666fc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:00.166296 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6d3c3292-d85a-4b48-8ab0-beafa96666fc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:00.166969 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6d3c3292-d85a-4b48-8ab0-beafa96666fc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:00.167415 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6d3c3292-d85a-4b48-8ab0-beafa96666fc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:00.167834 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6d3c3292-d85a-4b48-8ab0-beafa96666fc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:00.296995 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6d3c3292-d85a-4b48-8ab0-beafa96666fc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:00.304643 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6d3c3292-d85a-4b48-8ab0-beafa96666fc tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.150226 Sep 26 05:40:00.305202 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 589/1154] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:00 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:01.326957 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1e4ba5b2-8139-4919-bc3b-4e254a167ce8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:01.327518 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1e4ba5b2-8139-4919-bc3b-4e254a167ce8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:01.334714 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e4ba5b2-8139-4919-bc3b-4e254a167ce8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:01.335203 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e4ba5b2-8139-4919-bc3b-4e254a167ce8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:01.335640 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e4ba5b2-8139-4919-bc3b-4e254a167ce8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:01.336356 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e4ba5b2-8139-4919-bc3b-4e254a167ce8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:01.336813 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e4ba5b2-8139-4919-bc3b-4e254a167ce8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:01.337238 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e4ba5b2-8139-4919-bc3b-4e254a167ce8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:01.468974 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1e4ba5b2-8139-4919-bc3b-4e254a167ce8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:01.478140 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1e4ba5b2-8139-4919-bc3b-4e254a167ce8 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.155091 Sep 26 05:40:01.478717 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 566/1155] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:01 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:02.501579 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-21be5fdc-18be-4d2a-88ad-143c348c366d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:02.502853 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-21be5fdc-18be-4d2a-88ad-143c348c366d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:02.505452 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:02.514955 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-21be5fdc-18be-4d2a-88ad-143c348c366d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:02.515527 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-21be5fdc-18be-4d2a-88ad-143c348c366d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:02.515890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-21be5fdc-18be-4d2a-88ad-143c348c366d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:02.516630 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-21be5fdc-18be-4d2a-88ad-143c348c366d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:02.517187 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-21be5fdc-18be-4d2a-88ad-143c348c366d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:02.518187 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-21be5fdc-18be-4d2a-88ad-143c348c366d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:02.662501 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-21be5fdc-18be-4d2a-88ad-143c348c366d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:02.670504 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-21be5fdc-18be-4d2a-88ad-143c348c366d tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.173555 Sep 26 05:40:02.671074 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 590/1156] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:02 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:03.693600 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-56a492b1-fd7a-46bc-ac33-887c887c8c36 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:03.694197 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-56a492b1-fd7a-46bc-ac33-887c887c8c36 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:03.696096 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:03.696784 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=6 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:03.703206 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-56a492b1-fd7a-46bc-ac33-887c887c8c36 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:03.703625 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-56a492b1-fd7a-46bc-ac33-887c887c8c36 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:03.704060 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-56a492b1-fd7a-46bc-ac33-887c887c8c36 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:03.704770 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-56a492b1-fd7a-46bc-ac33-887c887c8c36 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:03.705718 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-56a492b1-fd7a-46bc-ac33-887c887c8c36 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:03.706123 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-56a492b1-fd7a-46bc-ac33-887c887c8c36 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:03.833093 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-56a492b1-fd7a-46bc-ac33-887c887c8c36 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:03.840686 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-56a492b1-fd7a-46bc-ac33-887c887c8c36 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.151110 Sep 26 05:40:03.841240 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 567/1157] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:03 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:04.642971 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-fccef8fb-ad6c-49d9-8b5a-38aedeafbcd9 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1008489683", "imageRef": "d37a4f3d-6311-48af-9e33-4c62c14cdd1a", "flavorRef": "452"}} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:40:04.695031 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.network.neutron [None req-fccef8fb-ad6c-49d9-8b5a-38aedeafbcd9 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] validate_networks() for None {{(pid=120806) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:40:04.865464 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3859e3f4-b1f3-4de9-9e46-000e9a4c414a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:04.866008 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3859e3f4-b1f3-4de9-9e46-000e9a4c414a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:04.872339 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3859e3f4-b1f3-4de9-9e46-000e9a4c414a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:04.872833 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3859e3f4-b1f3-4de9-9e46-000e9a4c414a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:04.873274 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3859e3f4-b1f3-4de9-9e46-000e9a4c414a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:04.873978 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3859e3f4-b1f3-4de9-9e46-000e9a4c414a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:04.874436 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3859e3f4-b1f3-4de9-9e46-000e9a4c414a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:04.874864 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3859e3f4-b1f3-4de9-9e46-000e9a4c414a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:05.006644 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-fccef8fb-ad6c-49d9-8b5a-38aedeafbcd9 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Flavor limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:40:05.007062 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-fccef8fb-ad6c-49d9-8b5a-38aedeafbcd9 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Image limits 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:40:05.007532 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-fccef8fb-ad6c-49d9-8b5a-38aedeafbcd9 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Flavor pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:40:05.007935 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-fccef8fb-ad6c-49d9-8b5a-38aedeafbcd9 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Image pref 0:0:0 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:40:05.008377 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.virt.hardware [None req-fccef8fb-ad6c-49d9-8b5a-38aedeafbcd9 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120806) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:40:05.016829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fccef8fb-ad6c-49d9-8b5a-38aedeafbcd9 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:05.017301 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fccef8fb-ad6c-49d9-8b5a-38aedeafbcd9 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:05.018403 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fccef8fb-ad6c-49d9-8b5a-38aedeafbcd9 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:05.019126 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fccef8fb-ad6c-49d9-8b5a-38aedeafbcd9 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:05.019574 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fccef8fb-ad6c-49d9-8b5a-38aedeafbcd9 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:05.019992 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-fccef8fb-ad6c-49d9-8b5a-38aedeafbcd9 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:05.037235 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-fccef8fb-ad6c-49d9-8b5a-38aedeafbcd9 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Getting quotas for project 4443d3eb0c4540419fe86007491b169b. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:40:05.041418 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.quota [None req-fccef8fb-ad6c-49d9-8b5a-38aedeafbcd9 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Getting quotas for user 7d27aeb98d394e50b2ecf45e63b10486 and project 4443d3eb0c4540419fe86007491b169b. Resources: {'cores', 'ram', 'instances'} {{(pid=120806) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:40:05.042587 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3859e3f4-b1f3-4de9-9e46-000e9a4c414a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:05.050115 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3859e3f4-b1f3-4de9-9e46-000e9a4c414a tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.189236 Sep 26 05:40:05.050673 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 568/1158] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:04 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:40:05.052501 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-fccef8fb-ad6c-49d9-8b5a-38aedeafbcd9 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Going to run 1 instances... {{(pid=120806) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:40:05.054809 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-fccef8fb-ad6c-49d9-8b5a-38aedeafbcd9 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d37a4f3d-6311-48af-9e33-4c62c14cdd1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120806) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:40:05.099528 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-fccef8fb-ad6c-49d9-8b5a-38aedeafbcd9 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.460348 Sep 26 05:40:05.100170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 591/1159] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 05:40:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:40:05.111825 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-eb48d507-e978-4850-809b-3c9873cf6897 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:05.112301 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-eb48d507-e978-4850-809b-3c9873cf6897 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:05.173107 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-eb48d507-e978-4850-809b-3c9873cf6897 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:05.180483 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-eb48d507-e978-4850-809b-3c9873cf6897 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1215 microversion: 2.1 time: 0.073103 Sep 26 05:40:05.181067 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 569/1160] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:05 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:06.073287 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-8ab086c6-c21c-4bbf-8abb-f030ec6ff241 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:06.073992 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-8ab086c6-c21c-4bbf-8abb-f030ec6ff241 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:06.081252 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8ab086c6-c21c-4bbf-8abb-f030ec6ff241 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:06.081740 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8ab086c6-c21c-4bbf-8abb-f030ec6ff241 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:06.082175 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8ab086c6-c21c-4bbf-8abb-f030ec6ff241 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:06.082868 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8ab086c6-c21c-4bbf-8abb-f030ec6ff241 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:06.083323 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8ab086c6-c21c-4bbf-8abb-f030ec6ff241 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:06.083745 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-8ab086c6-c21c-4bbf-8abb-f030ec6ff241 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:06.202860 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3de3499c-6d0f-445f-a00a-1f82bd9838cb tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:06.203471 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3de3499c-6d0f-445f-a00a-1f82bd9838cb tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:06.210357 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-8ab086c6-c21c-4bbf-8abb-f030ec6ff241 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:06.211250 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3de3499c-6d0f-445f-a00a-1f82bd9838cb tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:06.211749 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3de3499c-6d0f-445f-a00a-1f82bd9838cb tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:06.212186 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3de3499c-6d0f-445f-a00a-1f82bd9838cb tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:06.212909 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3de3499c-6d0f-445f-a00a-1f82bd9838cb tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:06.213366 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3de3499c-6d0f-445f-a00a-1f82bd9838cb tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:06.213791 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3de3499c-6d0f-445f-a00a-1f82bd9838cb tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:06.218211 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-8ab086c6-c21c-4bbf-8abb-f030ec6ff241 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.148891 Sep 26 05:40:06.218787 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 592/1161] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:06 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:06.276222 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3de3499c-6d0f-445f-a00a-1f82bd9838cb tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:06.284575 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3de3499c-6d0f-445f-a00a-1f82bd9838cb tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1219 microversion: 2.1 time: 0.085432 Sep 26 05:40:06.285146 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 570/1162] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:06 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:40:07.242303 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-ce6f9118-0870-4a34-8ce6-65a69ed0a391 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:07.242920 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-ce6f9118-0870-4a34-8ce6-65a69ed0a391 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:07.249356 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ce6f9118-0870-4a34-8ce6-65a69ed0a391 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:07.249843 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ce6f9118-0870-4a34-8ce6-65a69ed0a391 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:07.250281 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ce6f9118-0870-4a34-8ce6-65a69ed0a391 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:07.250963 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ce6f9118-0870-4a34-8ce6-65a69ed0a391 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:07.251414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ce6f9118-0870-4a34-8ce6-65a69ed0a391 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:07.252573 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-ce6f9118-0870-4a34-8ce6-65a69ed0a391 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:07.306860 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-de0c0416-2204-4733-ae5f-06e2eb7b5bc1 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:07.307476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-de0c0416-2204-4733-ae5f-06e2eb7b5bc1 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:07.313899 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-de0c0416-2204-4733-ae5f-06e2eb7b5bc1 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:07.314451 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-de0c0416-2204-4733-ae5f-06e2eb7b5bc1 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:07.315454 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-de0c0416-2204-4733-ae5f-06e2eb7b5bc1 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:07.316116 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-de0c0416-2204-4733-ae5f-06e2eb7b5bc1 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:07.316602 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-de0c0416-2204-4733-ae5f-06e2eb7b5bc1 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:07.317026 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-de0c0416-2204-4733-ae5f-06e2eb7b5bc1 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:07.383500 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-de0c0416-2204-4733-ae5f-06e2eb7b5bc1 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:07.391224 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-de0c0416-2204-4733-ae5f-06e2eb7b5bc1 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1219 microversion: 2.1 time: 0.088218 Sep 26 05:40:07.391805 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 571/1163] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:07 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:40:07.407454 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-ce6f9118-0870-4a34-8ce6-65a69ed0a391 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:07.415239 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-ce6f9118-0870-4a34-8ce6-65a69ed0a391 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.176812 Sep 26 05:40:07.415807 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 593/1164] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:07 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:08.413624 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f00a3049-33a7-47a3-8397-16252f94e853 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:08.414167 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f00a3049-33a7-47a3-8397-16252f94e853 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:08.420772 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f00a3049-33a7-47a3-8397-16252f94e853 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:08.421255 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f00a3049-33a7-47a3-8397-16252f94e853 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:08.421697 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f00a3049-33a7-47a3-8397-16252f94e853 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:08.422391 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f00a3049-33a7-47a3-8397-16252f94e853 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:08.422848 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f00a3049-33a7-47a3-8397-16252f94e853 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:08.423273 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f00a3049-33a7-47a3-8397-16252f94e853 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:08.438582 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5f1fa8f3-bce7-4e01-8012-369bde721b29 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:08.439199 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5f1fa8f3-bce7-4e01-8012-369bde721b29 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:08.446529 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f1fa8f3-bce7-4e01-8012-369bde721b29 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:08.447013 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f1fa8f3-bce7-4e01-8012-369bde721b29 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:08.447454 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f1fa8f3-bce7-4e01-8012-369bde721b29 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:08.448149 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f1fa8f3-bce7-4e01-8012-369bde721b29 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:08.448632 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f1fa8f3-bce7-4e01-8012-369bde721b29 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:08.449057 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5f1fa8f3-bce7-4e01-8012-369bde721b29 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:08.483605 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f00a3049-33a7-47a3-8397-16252f94e853 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:08.491468 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f00a3049-33a7-47a3-8397-16252f94e853 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1219 microversion: 2.1 time: 0.081770 Sep 26 05:40:08.492053 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 572/1165] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:08 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:08.586247 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5f1fa8f3-bce7-4e01-8012-369bde721b29 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:08.593912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5f1fa8f3-bce7-4e01-8012-369bde721b29 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.159151 Sep 26 05:40:08.594479 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 594/1166] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:08 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:40:09.515067 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cb0a2111-79ca-4190-a246-367ba48a001b tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:09.515682 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cb0a2111-79ca-4190-a246-367ba48a001b tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:09.522786 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb0a2111-79ca-4190-a246-367ba48a001b tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:09.523264 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb0a2111-79ca-4190-a246-367ba48a001b tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:09.523699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb0a2111-79ca-4190-a246-367ba48a001b tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:09.524425 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb0a2111-79ca-4190-a246-367ba48a001b tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:09.524876 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb0a2111-79ca-4190-a246-367ba48a001b tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:09.525301 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb0a2111-79ca-4190-a246-367ba48a001b tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:09.585710 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cb0a2111-79ca-4190-a246-367ba48a001b tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:09.593293 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cb0a2111-79ca-4190-a246-367ba48a001b tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1219 microversion: 2.1 time: 0.082294 Sep 26 05:40:09.594059 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 573/1167] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:09 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:09.616691 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-311da9c6-7aa8-44df-bb48-2c64cdb836c3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:09.617305 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-311da9c6-7aa8-44df-bb48-2c64cdb836c3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:09.623647 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-311da9c6-7aa8-44df-bb48-2c64cdb836c3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:09.624130 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-311da9c6-7aa8-44df-bb48-2c64cdb836c3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:09.624599 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-311da9c6-7aa8-44df-bb48-2c64cdb836c3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:09.625288 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-311da9c6-7aa8-44df-bb48-2c64cdb836c3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:09.625738 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-311da9c6-7aa8-44df-bb48-2c64cdb836c3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:09.626161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-311da9c6-7aa8-44df-bb48-2c64cdb836c3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:09.751718 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-311da9c6-7aa8-44df-bb48-2c64cdb836c3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:09.759472 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-311da9c6-7aa8-44df-bb48-2c64cdb836c3 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.146590 Sep 26 05:40:09.760043 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 595/1168] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:09 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:10.617320 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-52ec7db2-197a-450e-8687-c6aa0ec7faa4 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:10.617937 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-52ec7db2-197a-450e-8687-c6aa0ec7faa4 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:10.624340 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-52ec7db2-197a-450e-8687-c6aa0ec7faa4 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:10.624817 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-52ec7db2-197a-450e-8687-c6aa0ec7faa4 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:10.625246 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-52ec7db2-197a-450e-8687-c6aa0ec7faa4 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:10.625923 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-52ec7db2-197a-450e-8687-c6aa0ec7faa4 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:10.626370 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-52ec7db2-197a-450e-8687-c6aa0ec7faa4 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:10.626790 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-52ec7db2-197a-450e-8687-c6aa0ec7faa4 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:10.691348 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-52ec7db2-197a-450e-8687-c6aa0ec7faa4 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:10.698896 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-52ec7db2-197a-450e-8687-c6aa0ec7faa4 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1219 microversion: 2.1 time: 0.085450 Sep 26 05:40:10.699453 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 574/1169] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:10 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:10.782557 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7a43e257-518f-4b83-bc04-1a622e1d41d7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:10.783173 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7a43e257-518f-4b83-bc04-1a622e1d41d7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:10.790324 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7a43e257-518f-4b83-bc04-1a622e1d41d7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:10.790805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7a43e257-518f-4b83-bc04-1a622e1d41d7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:10.791240 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7a43e257-518f-4b83-bc04-1a622e1d41d7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:10.791931 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7a43e257-518f-4b83-bc04-1a622e1d41d7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:10.792415 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7a43e257-518f-4b83-bc04-1a622e1d41d7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:10.792838 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7a43e257-518f-4b83-bc04-1a622e1d41d7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:10.919522 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-7a43e257-518f-4b83-bc04-1a622e1d41d7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:10.927803 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7a43e257-518f-4b83-bc04-1a622e1d41d7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.149093 Sep 26 05:40:10.928400 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 596/1170] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:10 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:11.722185 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a13acd94-b7db-465b-9a5b-135684f39190 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:11.722801 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a13acd94-b7db-465b-9a5b-135684f39190 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:11.729260 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a13acd94-b7db-465b-9a5b-135684f39190 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:11.729739 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a13acd94-b7db-465b-9a5b-135684f39190 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:11.730175 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a13acd94-b7db-465b-9a5b-135684f39190 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:11.730857 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a13acd94-b7db-465b-9a5b-135684f39190 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:11.731307 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a13acd94-b7db-465b-9a5b-135684f39190 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:11.731734 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a13acd94-b7db-465b-9a5b-135684f39190 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:11.790738 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a13acd94-b7db-465b-9a5b-135684f39190 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:11.798649 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a13acd94-b7db-465b-9a5b-135684f39190 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1219 microversion: 2.1 time: 0.080781 Sep 26 05:40:11.799898 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 575/1171] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:11 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:11.950625 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-9fd0d830-b1f2-4d78-ac9e-f344b9af622e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:11.951242 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-9fd0d830-b1f2-4d78-ac9e-f344b9af622e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:11.957736 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9fd0d830-b1f2-4d78-ac9e-f344b9af622e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:11.958212 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9fd0d830-b1f2-4d78-ac9e-f344b9af622e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:11.958648 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9fd0d830-b1f2-4d78-ac9e-f344b9af622e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:11.959380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9fd0d830-b1f2-4d78-ac9e-f344b9af622e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:11.959831 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9fd0d830-b1f2-4d78-ac9e-f344b9af622e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:11.960267 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-9fd0d830-b1f2-4d78-ac9e-f344b9af622e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:12.093228 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-9fd0d830-b1f2-4d78-ac9e-f344b9af622e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:12.101850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-9fd0d830-b1f2-4d78-ac9e-f344b9af622e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.155132 Sep 26 05:40:12.102412 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 597/1172] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:11 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:12.413460 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8849a3b7-4135-491b-85b7-5b47bbf1d0ac tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-232110990"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:40:12.413993 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8849a3b7-4135-491b-85b7-5b47bbf1d0ac tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:12.419856 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8849a3b7-4135-491b-85b7-5b47bbf1d0ac tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:12.420372 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8849a3b7-4135-491b-85b7-5b47bbf1d0ac tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:12.420809 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8849a3b7-4135-491b-85b7-5b47bbf1d0ac tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:12.421489 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8849a3b7-4135-491b-85b7-5b47bbf1d0ac tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:12.421934 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8849a3b7-4135-491b-85b7-5b47bbf1d0ac tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:12.422353 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8849a3b7-4135-491b-85b7-5b47bbf1d0ac tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:12.547155 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.network.security_group_api [None req-8849a3b7-4135-491b-85b7-5b47bbf1d0ac tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Removing security group beb46e1e-e3d5-4418-93f8-6107d39b0841 from port 3211bad3-a3ee-47c8-a87f-240818a7928b Sep 26 05:40:12.823840 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d62ad2b7-b6c1-415b-8f74-54d492f28587 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:12.824503 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d62ad2b7-b6c1-415b-8f74-54d492f28587 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:12.831276 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d62ad2b7-b6c1-415b-8f74-54d492f28587 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:12.831771 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d62ad2b7-b6c1-415b-8f74-54d492f28587 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:12.832213 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d62ad2b7-b6c1-415b-8f74-54d492f28587 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:12.832940 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d62ad2b7-b6c1-415b-8f74-54d492f28587 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:12.833397 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d62ad2b7-b6c1-415b-8f74-54d492f28587 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:12.833820 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d62ad2b7-b6c1-415b-8f74-54d492f28587 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:12.920078 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d62ad2b7-b6c1-415b-8f74-54d492f28587 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:12.928080 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d62ad2b7-b6c1-415b-8f74-54d492f28587 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1219 microversion: 2.1 time: 0.109686 Sep 26 05:40:12.928681 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 598/1173] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:12 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:40:13.113898 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8849a3b7-4135-491b-85b7-5b47bbf1d0ac tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "POST /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac/action" status: 202 len: 0 microversion: 2.1 time: 0.704338 Sep 26 05:40:13.114508 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 576/1174] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 05:40:12 2022] POST /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac/action => generated 0 bytes in 706 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:40:13.126518 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9bd0c8cc-46aa-4304-bc01-e90c8fb919e5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:13.126518 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9bd0c8cc-46aa-4304-bc01-e90c8fb919e5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:13.138625 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9bd0c8cc-46aa-4304-bc01-e90c8fb919e5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:13.139187 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9bd0c8cc-46aa-4304-bc01-e90c8fb919e5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:13.139797 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9bd0c8cc-46aa-4304-bc01-e90c8fb919e5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:13.140716 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9bd0c8cc-46aa-4304-bc01-e90c8fb919e5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:13.141470 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9bd0c8cc-46aa-4304-bc01-e90c8fb919e5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:13.142088 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9bd0c8cc-46aa-4304-bc01-e90c8fb919e5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:13.303251 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9bd0c8cc-46aa-4304-bc01-e90c8fb919e5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:13.313241 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-b79f50bd-bd9a-4985-afe9-ab0327fe7d63 req-3205d0c7-3743-42f0-b42f-0b79c2bf91c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2df85633-fcf8-4640-bfac-ffc0f55778ac", "tag": "3211bad3-a3ee-47c8-a87f-240818a7928b"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:40:13.319498 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9bd0c8cc-46aa-4304-bc01-e90c8fb919e5 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.197060 Sep 26 05:40:13.320565 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 577/1175] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:13 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:40:13.326612 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-b79f50bd-bd9a-4985-afe9-ab0327fe7d63 req-3205d0c7-3743-42f0-b42f-0b79c2bf91c6 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:13.327298 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-b79f50bd-bd9a-4985-afe9-ab0327fe7d63 req-3205d0c7-3743-42f0-b42f-0b79c2bf91c6 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:13.328560 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-b79f50bd-bd9a-4985-afe9-ab0327fe7d63 req-3205d0c7-3743-42f0-b42f-0b79c2bf91c6 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:13.341850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-b79f50bd-bd9a-4985-afe9-ab0327fe7d63 req-3205d0c7-3743-42f0-b42f-0b79c2bf91c6 service nova] Creating event network-changed:3211bad3-a3ee-47c8-a87f-240818a7928b for instance 2df85633-fcf8-4640-bfac-ffc0f55778ac on hv-cinder-85918 Sep 26 05:40:13.348413 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-b79f50bd-bd9a-4985-afe9-ab0327fe7d63 req-3205d0c7-3743-42f0-b42f-0b79c2bf91c6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229934 Sep 26 05:40:13.349007 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 599/1176] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:40:13.951587 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c2615269-9b93-417c-956e-13253e26f740 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:13.952225 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c2615269-9b93-417c-956e-13253e26f740 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:13.959381 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c2615269-9b93-417c-956e-13253e26f740 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:13.959868 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c2615269-9b93-417c-956e-13253e26f740 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:13.960540 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c2615269-9b93-417c-956e-13253e26f740 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:13.961243 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c2615269-9b93-417c-956e-13253e26f740 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:13.961722 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c2615269-9b93-417c-956e-13253e26f740 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:13.962170 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c2615269-9b93-417c-956e-13253e26f740 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:14.028283 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c2615269-9b93-417c-956e-13253e26f740 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:14.036656 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c2615269-9b93-417c-956e-13253e26f740 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1267 microversion: 2.1 time: 0.088937 Sep 26 05:40:14.037223 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 578/1177] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:13 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:14.291407 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5eb2f17e-2e12-4543-9b9d-4449f72ce698 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:14.292009 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5eb2f17e-2e12-4543-9b9d-4449f72ce698 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:14.300229 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5eb2f17e-2e12-4543-9b9d-4449f72ce698 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:14.301007 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5eb2f17e-2e12-4543-9b9d-4449f72ce698 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:14.301623 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5eb2f17e-2e12-4543-9b9d-4449f72ce698 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:14.302502 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5eb2f17e-2e12-4543-9b9d-4449f72ce698 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:14.303191 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5eb2f17e-2e12-4543-9b9d-4449f72ce698 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:14.303780 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5eb2f17e-2e12-4543-9b9d-4449f72ce698 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:14.344130 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a3f39bde-f248-48c6-afa7-c59a98839484 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:14.345245 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a3f39bde-f248-48c6-afa7-c59a98839484 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:14.353179 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a3f39bde-f248-48c6-afa7-c59a98839484 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:14.354104 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a3f39bde-f248-48c6-afa7-c59a98839484 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:14.354903 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a3f39bde-f248-48c6-afa7-c59a98839484 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:14.355878 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a3f39bde-f248-48c6-afa7-c59a98839484 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:14.356595 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a3f39bde-f248-48c6-afa7-c59a98839484 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:14.357246 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a3f39bde-f248-48c6-afa7-c59a98839484 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:14.449897 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.objects.instance [None req-5eb2f17e-2e12-4543-9b9d-4449f72ce698 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lazy-loading 'services' on Instance uuid 2df85633-fcf8-4640-bfac-ffc0f55778ac {{(pid=120806) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:40:14.610283 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5eb2f17e-2e12-4543-9b9d-4449f72ce698 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac/os-volume_attachments/dc9dcdfc-6113-4d10-b7a4-f2c40d8e4f8d" status: 202 len: 0 microversion: 2.1 time: 0.326403 Sep 26 05:40:14.615835 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 600/1178] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 05:40:14 2022] DELETE /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac/os-volume_attachments/dc9dcdfc-6113-4d10-b7a4-f2c40d8e4f8d => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:40:14.623336 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-be9a2ff7-19dc-4095-b4be-063a71ab7ec3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:14.626937 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-be9a2ff7-19dc-4095-b4be-063a71ab7ec3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:14.635370 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-be9a2ff7-19dc-4095-b4be-063a71ab7ec3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:14.636741 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-be9a2ff7-19dc-4095-b4be-063a71ab7ec3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:14.637414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-be9a2ff7-19dc-4095-b4be-063a71ab7ec3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:14.638392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-be9a2ff7-19dc-4095-b4be-063a71ab7ec3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:14.639350 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-be9a2ff7-19dc-4095-b4be-063a71ab7ec3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:14.640007 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-be9a2ff7-19dc-4095-b4be-063a71ab7ec3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:14.653166 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a3f39bde-f248-48c6-afa7-c59a98839484 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:14.676168 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a3f39bde-f248-48c6-afa7-c59a98839484 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.325059 Sep 26 05:40:14.676889 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 579/1179] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:14 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:14.699700 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-be9a2ff7-19dc-4095-b4be-063a71ab7ec3 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082093 Sep 26 05:40:14.704690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 601/1180] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:40:14 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:40:15.062139 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9d05e143-aa9b-4b55-8094-3fab2cc0e596 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:15.062984 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9d05e143-aa9b-4b55-8094-3fab2cc0e596 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:15.070303 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d05e143-aa9b-4b55-8094-3fab2cc0e596 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:15.070598 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d05e143-aa9b-4b55-8094-3fab2cc0e596 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:15.071294 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d05e143-aa9b-4b55-8094-3fab2cc0e596 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:15.072326 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d05e143-aa9b-4b55-8094-3fab2cc0e596 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:15.073046 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d05e143-aa9b-4b55-8094-3fab2cc0e596 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:15.073690 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d05e143-aa9b-4b55-8094-3fab2cc0e596 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:15.078521 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:15.159391 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9d05e143-aa9b-4b55-8094-3fab2cc0e596 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:15.169064 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9d05e143-aa9b-4b55-8094-3fab2cc0e596 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1273 microversion: 2.1 time: 0.111059 Sep 26 05:40:15.170221 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 580/1181] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:15 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:15.363669 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-bcb7a6fc-6a50-447d-bf82-f5019f3113f3 req-1605e659-3bc5-4936-b11a-1e782c915624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2df85633-fcf8-4640-bfac-ffc0f55778ac", "tag": "3211bad3-a3ee-47c8-a87f-240818a7928b"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:40:15.371643 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=2 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:15.372423 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell0:SELECT=6 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:15.381218 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-bcb7a6fc-6a50-447d-bf82-f5019f3113f3 req-1605e659-3bc5-4936-b11a-1e782c915624 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:15.383218 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-bcb7a6fc-6a50-447d-bf82-f5019f3113f3 req-1605e659-3bc5-4936-b11a-1e782c915624 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:15.384339 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-bcb7a6fc-6a50-447d-bf82-f5019f3113f3 req-1605e659-3bc5-4936-b11a-1e782c915624 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:15.401507 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-bcb7a6fc-6a50-447d-bf82-f5019f3113f3 req-1605e659-3bc5-4936-b11a-1e782c915624 service nova] Creating event network-changed:3211bad3-a3ee-47c8-a87f-240818a7928b for instance 2df85633-fcf8-4640-bfac-ffc0f55778ac on hv-cinder-85918 Sep 26 05:40:15.413774 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-bcb7a6fc-6a50-447d-bf82-f5019f3113f3 req-1605e659-3bc5-4936-b11a-1e782c915624 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054089 Sep 26 05:40:15.414831 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 602/1182] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:40:15.701772 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-07bc3290-98aa-4b17-a8f1-a01214542198 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:15.702448 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-07bc3290-98aa-4b17-a8f1-a01214542198 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:15.704992 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:15.711319 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-07bc3290-98aa-4b17-a8f1-a01214542198 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:15.711805 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-07bc3290-98aa-4b17-a8f1-a01214542198 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:15.712935 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-07bc3290-98aa-4b17-a8f1-a01214542198 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:15.713827 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-07bc3290-98aa-4b17-a8f1-a01214542198 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:15.714442 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-07bc3290-98aa-4b17-a8f1-a01214542198 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:15.715139 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-07bc3290-98aa-4b17-a8f1-a01214542198 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:15.715450 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-305000bb-d897-4f5f-bacf-dc8c77233dc6 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:15.718288 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-305000bb-d897-4f5f-bacf-dc8c77233dc6 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:15.727162 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-305000bb-d897-4f5f-bacf-dc8c77233dc6 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:15.728018 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-305000bb-d897-4f5f-bacf-dc8c77233dc6 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:15.728757 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-305000bb-d897-4f5f-bacf-dc8c77233dc6 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:15.730685 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-305000bb-d897-4f5f-bacf-dc8c77233dc6 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:15.731476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-305000bb-d897-4f5f-bacf-dc8c77233dc6 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:15.732774 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-305000bb-d897-4f5f-bacf-dc8c77233dc6 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:15.768424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:15.774112 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-305000bb-d897-4f5f-bacf-dc8c77233dc6 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064897 Sep 26 05:40:15.776297 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 603/1183] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 05:40:15 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:40:15.787487 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5339f7bd-be51-4967-be06-bbfcad95f6df tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:15.788285 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5339f7bd-be51-4967-be06-bbfcad95f6df tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:15.794985 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5339f7bd-be51-4967-be06-bbfcad95f6df tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:15.795697 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5339f7bd-be51-4967-be06-bbfcad95f6df tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:15.796463 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5339f7bd-be51-4967-be06-bbfcad95f6df tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:15.797170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5339f7bd-be51-4967-be06-bbfcad95f6df tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:15.797615 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5339f7bd-be51-4967-be06-bbfcad95f6df tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:15.798194 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5339f7bd-be51-4967-be06-bbfcad95f6df tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:15.868014 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-07bc3290-98aa-4b17-a8f1-a01214542198 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:15.876950 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-07bc3290-98aa-4b17-a8f1-a01214542198 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.179069 Sep 26 05:40:15.878325 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 581/1184] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:15 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:15.890274 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-5339f7bd-be51-4967-be06-bbfcad95f6df tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] HTTP exception thrown: Instance 2df85633-fcf8-4640-bfac-ffc0f55778ac is not attached to volume dc9dcdfc-6113-4d10-b7a4-f2c40d8e4f8d Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5339f7bd-be51-4967-be06-bbfcad95f6df tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Request method failure captured: Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: DELETE /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac/os-volume_attachments/dc9dcdfc-6113-4d10-b7a4-f2c40d8e4f8d HTTP/1.1 Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTqH751e25qGpwmeE_ghdns7gm7QKqN0Z2Ux_aJ-NJnDQgqtnBXw6m2QgcZZfBbIvY-MeudTd8P726ca6jcWc5dF-5bL0WJU_qZ2o2a1sqxZ-DDTt00SmmJsm2S0nUdtuDnq3alht4x1WmyKEe_BEMXoF4Sg_JABpxq7jOxg7KWu7nk Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: acb97fc9f6ca4cc3970ba2192c2fa3c1 Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-TestMinimumBasicScenario-2061202646 Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:40:15.895414 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:40:15.897392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/acb97fc9f6ca4cc3970ba2192c2fa3c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/acb97fc9f6ca4cc3970ba2192c2fa3c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/acb97fc9f6ca4cc3970ba2192c2fa3c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_acb97fc9f6ca4cc3970ba2192c2fa3c1"}]}] Sep 26 05:40:15.897392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-TestMinimumBasicScenario-2061202646 Sep 26 05:40:15.897392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: acb97fc9f6ca4cc3970ba2192c2fa3c1 Sep 26 05:40:15.897392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2061202646 Sep 26 05:40:15.897392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-TestMinimumBasicScenario-2061202646-project Sep 26 05:40:15.897392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:40:15.897392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:40:15.897392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 12f9f5e7d546480ea24913421273d9b4 Sep 26 05:40:15.897392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-TestMinimumBasicScenario-2061202646-project Sep 26 05:40:15.897392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:40:15.897392 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance 2df85633-fcf8-4640-bfac-ffc0f55778ac is not attached to volume dc9dcdfc-6113-4d10-b7a4-f2c40d8e4f8d Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'server_id': '2df85633-fcf8-4640-bfac-ffc0f55778ac', 'id': 'dc9dcdfc-6113-4d10-b7a4-f2c40d8e4f8d'} Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id dc9dcdfc-6113-4d10-b7a4-f2c40d8e4f8d. Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:40:15.898379 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:40:15.899878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:40:15.899878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 26 05:40:15.899878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 26 05:40:15.899878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2df85633-fcf8-4640-bfac-ffc0f55778ac is not attached to volume dc9dcdfc-6113-4d10-b7a4-f2c40d8e4f8d Sep 26 05:40:15.899878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:40:15.899878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:40:15.899878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:40:15.899878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:40:15.899878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:40:15.899878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:40:15.899878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:40:15.899878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:40:15.899878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2df85633-fcf8-4640-bfac-ffc0f55778ac is not attached to volume dc9dcdfc-6113-4d10-b7a4-f2c40d8e4f8d Sep 26 05:40:15.899878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:40:15.899878 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5339f7bd-be51-4967-be06-bbfcad95f6df tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Returning 404 to user: Instance 2df85633-fcf8-4640-bfac-ffc0f55778ac is not attached to volume dc9dcdfc-6113-4d10-b7a4-f2c40d8e4f8d {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:40:15.901005 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5339f7bd-be51-4967-be06-bbfcad95f6df tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac/os-volume_attachments/dc9dcdfc-6113-4d10-b7a4-f2c40d8e4f8d" status: 404 len: 154 microversion: 2.1 time: 0.116244 Sep 26 05:40:15.901005 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 604/1185] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 05:40:15 2022] DELETE /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac/os-volume_attachments/dc9dcdfc-6113-4d10-b7a4-f2c40d8e4f8d => generated 154 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:40:16.194108 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bb6bbf3f-10dd-449b-b6d8-343be83fa028 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:16.194994 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bb6bbf3f-10dd-449b-b6d8-343be83fa028 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:16.201860 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bb6bbf3f-10dd-449b-b6d8-343be83fa028 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:16.202508 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bb6bbf3f-10dd-449b-b6d8-343be83fa028 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:16.203205 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bb6bbf3f-10dd-449b-b6d8-343be83fa028 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:16.204395 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bb6bbf3f-10dd-449b-b6d8-343be83fa028 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:16.205130 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bb6bbf3f-10dd-449b-b6d8-343be83fa028 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:16.206153 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bb6bbf3f-10dd-449b-b6d8-343be83fa028 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:16.354942 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bb6bbf3f-10dd-449b-b6d8-343be83fa028 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:16.365054 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bb6bbf3f-10dd-449b-b6d8-343be83fa028 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1315 microversion: 2.1 time: 0.175529 Sep 26 05:40:16.372398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 582/1186] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:16 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:16.467427 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-48117361-59ae-4d96-a277-fa83399bafd4 req-4de768cc-9774-4389-b7b8-4c63c0dea896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c532b0-9ad5-4519-ad88-2b61859b648f", "name": "network-vif-plugged", "status": "completed", "tag": "19481f78-5754-457c-8919-13eca736d5eb"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:40:16.487152 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-48117361-59ae-4d96-a277-fa83399bafd4 req-4de768cc-9774-4389-b7b8-4c63c0dea896 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:16.488187 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-48117361-59ae-4d96-a277-fa83399bafd4 req-4de768cc-9774-4389-b7b8-4c63c0dea896 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:16.488688 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-48117361-59ae-4d96-a277-fa83399bafd4 req-4de768cc-9774-4389-b7b8-4c63c0dea896 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:16.499291 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-48117361-59ae-4d96-a277-fa83399bafd4 req-4de768cc-9774-4389-b7b8-4c63c0dea896 service nova] Creating event network-vif-plugged:19481f78-5754-457c-8919-13eca736d5eb for instance 05c532b0-9ad5-4519-ad88-2b61859b648f on hv-cinder-85918 Sep 26 05:40:16.504531 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-48117361-59ae-4d96-a277-fa83399bafd4 req-4de768cc-9774-4389-b7b8-4c63c0dea896 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103602 Sep 26 05:40:16.505165 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 605/1187] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:40:16.644503 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-99d2a47c-e5ca-40c9-b2eb-da7670d19229 req-821ec586-925a-4cb3-aa10-8f3eb73c42dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afab04cf-716e-47ea-a651-58d52da6a017", "tag": "3c3c2e99-bc02-48cd-9404-484d9c459608"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:40:16.654414 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-99d2a47c-e5ca-40c9-b2eb-da7670d19229 req-821ec586-925a-4cb3-aa10-8f3eb73c42dd service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:16.654905 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-99d2a47c-e5ca-40c9-b2eb-da7670d19229 req-821ec586-925a-4cb3-aa10-8f3eb73c42dd service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:16.655336 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-99d2a47c-e5ca-40c9-b2eb-da7670d19229 req-821ec586-925a-4cb3-aa10-8f3eb73c42dd service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:16.668099 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-99d2a47c-e5ca-40c9-b2eb-da7670d19229 req-821ec586-925a-4cb3-aa10-8f3eb73c42dd service nova] Creating event network-changed:3c3c2e99-bc02-48cd-9404-484d9c459608 for instance afab04cf-716e-47ea-a651-58d52da6a017 on hv-cinder-85918 Sep 26 05:40:16.673544 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-99d2a47c-e5ca-40c9-b2eb-da7670d19229 req-821ec586-925a-4cb3-aa10-8f3eb73c42dd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096692 Sep 26 05:40:16.674405 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 583/1188] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:40:16.903541 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-3e6dbdbc-fce6-48f2-926e-f1afad82cd67 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:16.904277 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-3e6dbdbc-fce6-48f2-926e-f1afad82cd67 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:16.910531 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3e6dbdbc-fce6-48f2-926e-f1afad82cd67 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:16.911035 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3e6dbdbc-fce6-48f2-926e-f1afad82cd67 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:16.911482 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3e6dbdbc-fce6-48f2-926e-f1afad82cd67 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:16.912186 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3e6dbdbc-fce6-48f2-926e-f1afad82cd67 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:16.912675 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3e6dbdbc-fce6-48f2-926e-f1afad82cd67 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:16.913110 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-3e6dbdbc-fce6-48f2-926e-f1afad82cd67 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:17.049665 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-3e6dbdbc-fce6-48f2-926e-f1afad82cd67 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:17.052205 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9ab3c5fd-d24e-4b1e-98ed-dff98bff3105 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:17.052959 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9ab3c5fd-d24e-4b1e-98ed-dff98bff3105 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:17.057523 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-3e6dbdbc-fce6-48f2-926e-f1afad82cd67 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.158151 Sep 26 05:40:17.058086 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 606/1189] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:16 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:40:17.059048 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9ab3c5fd-d24e-4b1e-98ed-dff98bff3105 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:17.059527 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9ab3c5fd-d24e-4b1e-98ed-dff98bff3105 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:17.059960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9ab3c5fd-d24e-4b1e-98ed-dff98bff3105 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:17.060677 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9ab3c5fd-d24e-4b1e-98ed-dff98bff3105 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:17.061156 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9ab3c5fd-d24e-4b1e-98ed-dff98bff3105 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:17.061577 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9ab3c5fd-d24e-4b1e-98ed-dff98bff3105 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:17.086226 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9ab3c5fd-d24e-4b1e-98ed-dff98bff3105 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Going to try to terminate instance {{(pid=120805) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:40:17.160559 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9ab3c5fd-d24e-4b1e-98ed-dff98bff3105 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 204 len: 0 microversion: 2.1 time: 0.112772 Sep 26 05:40:17.161065 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 584/1190] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:40:17 2022] DELETE /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:40:17.169417 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-2eb09216-1374-447c-b02d-e6e5ff5c78e2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:17.170040 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-2eb09216-1374-447c-b02d-e6e5ff5c78e2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:17.176973 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2eb09216-1374-447c-b02d-e6e5ff5c78e2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:17.177454 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2eb09216-1374-447c-b02d-e6e5ff5c78e2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:17.177895 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2eb09216-1374-447c-b02d-e6e5ff5c78e2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:17.178622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2eb09216-1374-447c-b02d-e6e5ff5c78e2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:17.179186 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2eb09216-1374-447c-b02d-e6e5ff5c78e2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:17.179614 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-2eb09216-1374-447c-b02d-e6e5ff5c78e2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:17.309305 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-2eb09216-1374-447c-b02d-e6e5ff5c78e2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:17.317616 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-2eb09216-1374-447c-b02d-e6e5ff5c78e2 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1554 microversion: 2.1 time: 0.152129 Sep 26 05:40:17.318174 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 607/1191] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:17 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:17.388398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1c01a5e9-8ccf-4a85-a820-7218b536d726 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:17.389094 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1c01a5e9-8ccf-4a85-a820-7218b536d726 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:17.395545 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1c01a5e9-8ccf-4a85-a820-7218b536d726 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:17.396050 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1c01a5e9-8ccf-4a85-a820-7218b536d726 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:17.396507 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1c01a5e9-8ccf-4a85-a820-7218b536d726 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:17.397188 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1c01a5e9-8ccf-4a85-a820-7218b536d726 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:17.397636 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1c01a5e9-8ccf-4a85-a820-7218b536d726 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:17.398056 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1c01a5e9-8ccf-4a85-a820-7218b536d726 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:17.531528 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1c01a5e9-8ccf-4a85-a820-7218b536d726 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:17.539917 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1c01a5e9-8ccf-4a85-a820-7218b536d726 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1315 microversion: 2.1 time: 0.155615 Sep 26 05:40:17.540525 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 585/1192] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:17 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:18.081840 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a08afbbb-5be9-4f25-bbcf-47529a984958 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:18.082477 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a08afbbb-5be9-4f25-bbcf-47529a984958 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:18.089144 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a08afbbb-5be9-4f25-bbcf-47529a984958 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:18.089634 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a08afbbb-5be9-4f25-bbcf-47529a984958 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:18.090079 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a08afbbb-5be9-4f25-bbcf-47529a984958 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:18.090778 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a08afbbb-5be9-4f25-bbcf-47529a984958 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:18.091238 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a08afbbb-5be9-4f25-bbcf-47529a984958 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:18.091671 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a08afbbb-5be9-4f25-bbcf-47529a984958 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:18.220616 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a08afbbb-5be9-4f25-bbcf-47529a984958 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:18.228905 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a08afbbb-5be9-4f25-bbcf-47529a984958 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.151545 Sep 26 05:40:18.229476 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 608/1193] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:18 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:18.340726 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-54445c6b-d38f-4fdc-999b-a8c4f8dd05cd tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:18.341345 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-54445c6b-d38f-4fdc-999b-a8c4f8dd05cd tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:18.348918 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-54445c6b-d38f-4fdc-999b-a8c4f8dd05cd tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:18.349406 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-54445c6b-d38f-4fdc-999b-a8c4f8dd05cd tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:18.349844 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-54445c6b-d38f-4fdc-999b-a8c4f8dd05cd tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:18.350538 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-54445c6b-d38f-4fdc-999b-a8c4f8dd05cd tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:18.350992 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-54445c6b-d38f-4fdc-999b-a8c4f8dd05cd tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:18.351416 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-54445c6b-d38f-4fdc-999b-a8c4f8dd05cd tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:18.477023 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-54445c6b-d38f-4fdc-999b-a8c4f8dd05cd tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:18.484686 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-54445c6b-d38f-4fdc-999b-a8c4f8dd05cd tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1554 microversion: 2.1 time: 0.147843 Sep 26 05:40:18.485243 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 586/1194] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:18 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:18.562996 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-982c6b55-f230-431d-a4da-9785ef951656 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:18.563605 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-982c6b55-f230-431d-a4da-9785ef951656 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:18.570783 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-982c6b55-f230-431d-a4da-9785ef951656 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:18.571272 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-982c6b55-f230-431d-a4da-9785ef951656 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:18.571704 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-982c6b55-f230-431d-a4da-9785ef951656 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:18.572420 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-982c6b55-f230-431d-a4da-9785ef951656 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:18.572868 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-982c6b55-f230-431d-a4da-9785ef951656 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:18.573287 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-982c6b55-f230-431d-a4da-9785ef951656 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:18.704973 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-982c6b55-f230-431d-a4da-9785ef951656 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:18.712869 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-982c6b55-f230-431d-a4da-9785ef951656 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1315 microversion: 2.1 time: 0.153663 Sep 26 05:40:18.713444 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 609/1195] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:18 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:19.251706 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-030cd790-00c8-430e-8ef1-54459ad7cf27 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:19.252557 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-030cd790-00c8-430e-8ef1-54459ad7cf27 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:19.258728 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-030cd790-00c8-430e-8ef1-54459ad7cf27 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:19.259211 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-030cd790-00c8-430e-8ef1-54459ad7cf27 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:19.259643 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-030cd790-00c8-430e-8ef1-54459ad7cf27 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:19.260349 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-030cd790-00c8-430e-8ef1-54459ad7cf27 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:19.260831 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-030cd790-00c8-430e-8ef1-54459ad7cf27 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:19.261253 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-030cd790-00c8-430e-8ef1-54459ad7cf27 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:19.388838 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-030cd790-00c8-430e-8ef1-54459ad7cf27 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:19.397288 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-030cd790-00c8-430e-8ef1-54459ad7cf27 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1266 microversion: 2.1 time: 0.149587 Sep 26 05:40:19.397849 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 587/1196] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:19 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:19.508238 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-b4c68bb7-d405-4a80-9107-70f918c99c29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:19.508902 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-b4c68bb7-d405-4a80-9107-70f918c99c29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:19.515249 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b4c68bb7-d405-4a80-9107-70f918c99c29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:19.515740 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b4c68bb7-d405-4a80-9107-70f918c99c29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:19.516181 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b4c68bb7-d405-4a80-9107-70f918c99c29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:19.516903 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b4c68bb7-d405-4a80-9107-70f918c99c29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:19.517362 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b4c68bb7-d405-4a80-9107-70f918c99c29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:19.518285 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-b4c68bb7-d405-4a80-9107-70f918c99c29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:19.647873 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-b4c68bb7-d405-4a80-9107-70f918c99c29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:19.655622 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-b4c68bb7-d405-4a80-9107-70f918c99c29 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1554 microversion: 2.1 time: 0.151237 Sep 26 05:40:19.656189 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 610/1197] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:19 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:19.735604 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-13df40aa-7085-4ce6-9f00-b3c13b1d2892 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:19.736227 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-13df40aa-7085-4ce6-9f00-b3c13b1d2892 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:19.742476 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-13df40aa-7085-4ce6-9f00-b3c13b1d2892 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:19.742957 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-13df40aa-7085-4ce6-9f00-b3c13b1d2892 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:19.743396 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-13df40aa-7085-4ce6-9f00-b3c13b1d2892 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:19.744085 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-13df40aa-7085-4ce6-9f00-b3c13b1d2892 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:19.744569 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-13df40aa-7085-4ce6-9f00-b3c13b1d2892 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:19.744994 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-13df40aa-7085-4ce6-9f00-b3c13b1d2892 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:19.871090 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-13df40aa-7085-4ce6-9f00-b3c13b1d2892 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:19.879520 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-13df40aa-7085-4ce6-9f00-b3c13b1d2892 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1315 microversion: 2.1 time: 0.147796 Sep 26 05:40:19.880088 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 588/1198] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:19 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:20.420651 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-d63bbff8-24f8-4d75-bcac-b9aff3550563 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:20.421272 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-d63bbff8-24f8-4d75-bcac-b9aff3550563 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:20.427869 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d63bbff8-24f8-4d75-bcac-b9aff3550563 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:20.428375 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d63bbff8-24f8-4d75-bcac-b9aff3550563 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:20.428810 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d63bbff8-24f8-4d75-bcac-b9aff3550563 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:20.429486 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d63bbff8-24f8-4d75-bcac-b9aff3550563 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:20.430002 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d63bbff8-24f8-4d75-bcac-b9aff3550563 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:20.430418 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-d63bbff8-24f8-4d75-bcac-b9aff3550563 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:20.560416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-d63bbff8-24f8-4d75-bcac-b9aff3550563 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:20.569212 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-d63bbff8-24f8-4d75-bcac-b9aff3550563 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1453 microversion: 2.1 time: 0.152355 Sep 26 05:40:20.569782 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 611/1199] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:20 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:20.591498 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-614d9003-0508-41fa-ab55-60ed1bb3e323 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:20.592117 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-614d9003-0508-41fa-ab55-60ed1bb3e323 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:20.599968 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-614d9003-0508-41fa-ab55-60ed1bb3e323 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:20.600502 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-614d9003-0508-41fa-ab55-60ed1bb3e323 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:20.600944 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-614d9003-0508-41fa-ab55-60ed1bb3e323 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:20.601646 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-614d9003-0508-41fa-ab55-60ed1bb3e323 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:20.602105 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-614d9003-0508-41fa-ab55-60ed1bb3e323 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:20.602535 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-614d9003-0508-41fa-ab55-60ed1bb3e323 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:20.679317 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-bd07df99-5b93-4935-95e7-ead81c6fc706 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:20.679974 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-bd07df99-5b93-4935-95e7-ead81c6fc706 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:20.687161 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-bd07df99-5b93-4935-95e7-ead81c6fc706 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:20.687725 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-bd07df99-5b93-4935-95e7-ead81c6fc706 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:20.688230 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-bd07df99-5b93-4935-95e7-ead81c6fc706 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:20.689187 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-bd07df99-5b93-4935-95e7-ead81c6fc706 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:20.689783 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-bd07df99-5b93-4935-95e7-ead81c6fc706 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:20.690281 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-bd07df99-5b93-4935-95e7-ead81c6fc706 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:20.748075 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-614d9003-0508-41fa-ab55-60ed1bb3e323 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:20.757496 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-614d9003-0508-41fa-ab55-60ed1bb3e323 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1453 microversion: 2.1 time: 0.169782 Sep 26 05:40:20.758668 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 589/1200] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:20 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:20.842086 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-bd07df99-5b93-4935-95e7-ead81c6fc706 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:20.852274 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-bd07df99-5b93-4935-95e7-ead81c6fc706 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1554 microversion: 2.1 time: 0.176724 Sep 26 05:40:20.860329 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 612/1201] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:20 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:40:20.904149 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fde8a561-ed46-494f-8c42-b6a0a6375dec tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:20.905238 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fde8a561-ed46-494f-8c42-b6a0a6375dec tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:20.913724 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fde8a561-ed46-494f-8c42-b6a0a6375dec tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:20.914348 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fde8a561-ed46-494f-8c42-b6a0a6375dec tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:20.915363 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fde8a561-ed46-494f-8c42-b6a0a6375dec tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:20.916192 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fde8a561-ed46-494f-8c42-b6a0a6375dec tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:20.917280 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fde8a561-ed46-494f-8c42-b6a0a6375dec tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:20.917790 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fde8a561-ed46-494f-8c42-b6a0a6375dec tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:21.057811 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fde8a561-ed46-494f-8c42-b6a0a6375dec tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:21.066960 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fde8a561-ed46-494f-8c42-b6a0a6375dec tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1315 microversion: 2.1 time: 0.167821 Sep 26 05:40:21.074398 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 590/1202] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:20 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:21.668141 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-fc0ea833-c6a5-461e-975e-3749b142b145 req-a1667811-84af-4b5d-9a3d-c0528dda512d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2df85633-fcf8-4640-bfac-ffc0f55778ac", "name": "network-vif-deleted", "tag": "3211bad3-a3ee-47c8-a87f-240818a7928b"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:40:21.680027 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-fc0ea833-c6a5-461e-975e-3749b142b145 req-a1667811-84af-4b5d-9a3d-c0528dda512d service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:21.680867 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-fc0ea833-c6a5-461e-975e-3749b142b145 req-a1667811-84af-4b5d-9a3d-c0528dda512d service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:21.681429 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-fc0ea833-c6a5-461e-975e-3749b142b145 req-a1667811-84af-4b5d-9a3d-c0528dda512d service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:21.695960 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-fc0ea833-c6a5-461e-975e-3749b142b145 req-a1667811-84af-4b5d-9a3d-c0528dda512d service nova] Creating event network-vif-deleted:3211bad3-a3ee-47c8-a87f-240818a7928b for instance 2df85633-fcf8-4640-bfac-ffc0f55778ac on hv-cinder-85918 Sep 26 05:40:21.701828 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-fc0ea833-c6a5-461e-975e-3749b142b145 req-a1667811-84af-4b5d-9a3d-c0528dda512d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036687 Sep 26 05:40:21.702852 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 613/1203] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:40:21.877187 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-34add4df-90f4-44f9-bc61-bbbf468c9a5a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:21.878026 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-34add4df-90f4-44f9-bc61-bbbf468c9a5a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:21.884045 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:21.885816 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-34add4df-90f4-44f9-bc61-bbbf468c9a5a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:21.886282 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-34add4df-90f4-44f9-bc61-bbbf468c9a5a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:21.886761 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-34add4df-90f4-44f9-bc61-bbbf468c9a5a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:21.887448 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-34add4df-90f4-44f9-bc61-bbbf468c9a5a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:21.887859 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-34add4df-90f4-44f9-bc61-bbbf468c9a5a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:21.888338 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-34add4df-90f4-44f9-bc61-bbbf468c9a5a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:21.925218 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-34add4df-90f4-44f9-bc61-bbbf468c9a5a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:21.925905 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-34add4df-90f4-44f9-bc61-bbbf468c9a5a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:21.926351 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-34add4df-90f4-44f9-bc61-bbbf468c9a5a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:21.926801 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-34add4df-90f4-44f9-bc61-bbbf468c9a5a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lazy-loading 'fault' on Instance uuid 2df85633-fcf8-4640-bfac-ffc0f55778ac {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:40:21.991749 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-34add4df-90f4-44f9-bc61-bbbf468c9a5a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f9f5e7d546480ea24913421273d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb97fc9f6ca4cc3970ba2192c2fa3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:22.000099 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-34add4df-90f4-44f9-bc61-bbbf468c9a5a tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 200 len: 1348 microversion: 2.1 time: 0.126859 Sep 26 05:40:22.000991 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 591/1204] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:21 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 1348 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:22.090928 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-63292810-cf44-4700-a005-e636822f5745 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:22.091640 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-63292810-cf44-4700-a005-e636822f5745 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:22.094743 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:22.099779 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-63292810-cf44-4700-a005-e636822f5745 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:22.100286 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-63292810-cf44-4700-a005-e636822f5745 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:22.100923 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-63292810-cf44-4700-a005-e636822f5745 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:22.101813 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-63292810-cf44-4700-a005-e636822f5745 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:22.102443 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-63292810-cf44-4700-a005-e636822f5745 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:22.102868 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-63292810-cf44-4700-a005-e636822f5745 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:22.429404 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-63292810-cf44-4700-a005-e636822f5745 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:22.437271 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-63292810-cf44-4700-a005-e636822f5745 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1315 microversion: 2.1 time: 0.350676 Sep 26 05:40:22.437982 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 614/1205] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:22 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:22.892525 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-081438a0-c2d7-423e-befa-d5de4262b3d9 req-6cc1ea3f-6400-48ff-aba9-ef115e496c40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c532b0-9ad5-4519-ad88-2b61859b648f", "tag": "19481f78-5754-457c-8919-13eca736d5eb"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:40:22.907054 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-081438a0-c2d7-423e-befa-d5de4262b3d9 req-6cc1ea3f-6400-48ff-aba9-ef115e496c40 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:22.907561 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-081438a0-c2d7-423e-befa-d5de4262b3d9 req-6cc1ea3f-6400-48ff-aba9-ef115e496c40 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:22.908055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-081438a0-c2d7-423e-befa-d5de4262b3d9 req-6cc1ea3f-6400-48ff-aba9-ef115e496c40 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:22.925897 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-081438a0-c2d7-423e-befa-d5de4262b3d9 req-6cc1ea3f-6400-48ff-aba9-ef115e496c40 service nova] Creating event network-changed:19481f78-5754-457c-8919-13eca736d5eb for instance 05c532b0-9ad5-4519-ad88-2b61859b648f on hv-cinder-85918 Sep 26 05:40:22.932055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-081438a0-c2d7-423e-befa-d5de4262b3d9 req-6cc1ea3f-6400-48ff-aba9-ef115e496c40 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045906 Sep 26 05:40:22.933045 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 592/1206] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:40:23.024757 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f4c450db-f1a4-4402-a36f-4e7d47cde4cc tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:23.025628 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-f4c450db-f1a4-4402-a36f-4e7d47cde4cc tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] [instance: 2df85633-fcf8-4640-bfac-ffc0f55778ac] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:23.032429 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f4c450db-f1a4-4402-a36f-4e7d47cde4cc tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:23.033006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f4c450db-f1a4-4402-a36f-4e7d47cde4cc tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:23.033558 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f4c450db-f1a4-4402-a36f-4e7d47cde4cc tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:23.034559 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f4c450db-f1a4-4402-a36f-4e7d47cde4cc tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:23.035262 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f4c450db-f1a4-4402-a36f-4e7d47cde4cc tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:23.035752 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-f4c450db-f1a4-4402-a36f-4e7d47cde4cc tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:23.050717 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-f4c450db-f1a4-4402-a36f-4e7d47cde4cc tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] HTTP exception thrown: Instance 2df85633-fcf8-4640-bfac-ffc0f55778ac could not be found. Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f4c450db-f1a4-4402-a36f-4e7d47cde4cc tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Request method failure captured: Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac HTTP/1.1 Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTqH751e25qGpwmeE_ghdns7gm7QKqN0Z2Ux_aJ-NJnDQgqtnBXw6m2QgcZZfBbIvY-MeudTd8P726ca6jcWc5dF-5bL0WJU_qZ2o2a1sqxZ-DDTt00SmmJsm2S0nUdtuDnq3alht4x1WmyKEe_BEMXoF4Sg_JABpxq7jOxg7KWu7nk Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: acb97fc9f6ca4cc3970ba2192c2fa3c1 Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-TestMinimumBasicScenario-2061202646 Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:40:23.051959 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:40:23.053763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/acb97fc9f6ca4cc3970ba2192c2fa3c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/acb97fc9f6ca4cc3970ba2192c2fa3c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/acb97fc9f6ca4cc3970ba2192c2fa3c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_acb97fc9f6ca4cc3970ba2192c2fa3c1"}]}] Sep 26 05:40:23.053763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-TestMinimumBasicScenario-2061202646 Sep 26 05:40:23.053763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: acb97fc9f6ca4cc3970ba2192c2fa3c1 Sep 26 05:40:23.053763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2061202646 Sep 26 05:40:23.053763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-TestMinimumBasicScenario-2061202646-project Sep 26 05:40:23.053763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:40:23.053763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:40:23.053763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 12f9f5e7d546480ea24913421273d9b4 Sep 26 05:40:23.053763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-TestMinimumBasicScenario-2061202646-project Sep 26 05:40:23.053763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:40:23.053763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance 2df85633-fcf8-4640-bfac-ffc0f55778ac could not be found. Sep 26 05:40:23.053763 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': '2df85633-fcf8-4640-bfac-ffc0f55778ac'} Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2df85633-fcf8-4640-bfac-ffc0f55778ac could not be found. Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:40:23.054655 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:40:23.056095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:40:23.056095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:40:23.056095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:40:23.056095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:40:23.056095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:40:23.056095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:40:23.056095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:40:23.056095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2df85633-fcf8-4640-bfac-ffc0f55778ac could not be found. Sep 26 05:40:23.056095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:40:23.056095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:40:23.056095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:40:23.056095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:40:23.056095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:40:23.056095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:40:23.056095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:40:23.056095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:40:23.056095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2df85633-fcf8-4640-bfac-ffc0f55778ac could not be found. Sep 26 05:40:23.056095 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:40:23.057438 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-f4c450db-f1a4-4402-a36f-4e7d47cde4cc tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Returning 404 to user: Instance 2df85633-fcf8-4640-bfac-ffc0f55778ac could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:40:23.057438 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-f4c450db-f1a4-4402-a36f-4e7d47cde4cc tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac" status: 404 len: 111 microversion: 2.1 time: 0.032866 Sep 26 05:40:23.057438 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 615/1207] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:23 2022] GET /compute/v2.1/servers/2df85633-fcf8-4640-bfac-ffc0f55778ac => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:40:23.064095 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3aa8868d-1130-4fd2-bb5e-cb673cb97a52 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] Calling method '.version_select at 0x7fd7b7532af0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:23.090535 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3aa8868d-1130-4fd2-bb5e-cb673cb97a52 tempest-TestMinimumBasicScenario-2061202646 tempest-TestMinimumBasicScenario-2061202646-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1358970797" status: 202 len: 0 microversion: 2.1 time: 0.030990 Sep 26 05:40:23.091478 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 593/1208] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Sep 26 05:40:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1358970797 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:40:23.460510 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-a1c9bb8c-37a8-466d-b7e8-299d3d7be600 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:23.468023 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-a1c9bb8c-37a8-466d-b7e8-299d3d7be600 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:23.475646 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a1c9bb8c-37a8-466d-b7e8-299d3d7be600 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:23.476535 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a1c9bb8c-37a8-466d-b7e8-299d3d7be600 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:23.477151 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a1c9bb8c-37a8-466d-b7e8-299d3d7be600 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:23.478302 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a1c9bb8c-37a8-466d-b7e8-299d3d7be600 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:23.479177 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a1c9bb8c-37a8-466d-b7e8-299d3d7be600 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:23.479770 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-a1c9bb8c-37a8-466d-b7e8-299d3d7be600 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:23.714006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-a1c9bb8c-37a8-466d-b7e8-299d3d7be600 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:23.725400 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-a1c9bb8c-37a8-466d-b7e8-299d3d7be600 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1315 microversion: 2.1 time: 0.268807 Sep 26 05:40:23.727582 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 616/1209] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:23 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:24.419318 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-ad7e4022-adf3-42c4-923b-87b3d1ca10a2 req-8b49fc99-b30c-40c6-a513-baa63eddf160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afab04cf-716e-47ea-a651-58d52da6a017", "name": "network-vif-plugged", "status": "completed", "tag": "3c3c2e99-bc02-48cd-9404-484d9c459608"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:40:24.430588 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-ad7e4022-adf3-42c4-923b-87b3d1ca10a2 req-8b49fc99-b30c-40c6-a513-baa63eddf160 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:24.431077 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-ad7e4022-adf3-42c4-923b-87b3d1ca10a2 req-8b49fc99-b30c-40c6-a513-baa63eddf160 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:24.431596 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-ad7e4022-adf3-42c4-923b-87b3d1ca10a2 req-8b49fc99-b30c-40c6-a513-baa63eddf160 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:24.443431 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-ad7e4022-adf3-42c4-923b-87b3d1ca10a2 req-8b49fc99-b30c-40c6-a513-baa63eddf160 service nova] Creating event network-vif-plugged:3c3c2e99-bc02-48cd-9404-484d9c459608 for instance afab04cf-716e-47ea-a651-58d52da6a017 on hv-cinder-85918 Sep 26 05:40:24.448271 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-ad7e4022-adf3-42c4-923b-87b3d1ca10a2 req-8b49fc99-b30c-40c6-a513-baa63eddf160 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033540 Sep 26 05:40:24.449295 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 594/1210] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:40:24.750535 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e283de90-cb44-4af2-9ece-f3870b2105f3 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:24.751331 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e283de90-cb44-4af2-9ece-f3870b2105f3 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:24.758725 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e283de90-cb44-4af2-9ece-f3870b2105f3 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:24.759274 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e283de90-cb44-4af2-9ece-f3870b2105f3 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:24.759744 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e283de90-cb44-4af2-9ece-f3870b2105f3 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:24.760612 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e283de90-cb44-4af2-9ece-f3870b2105f3 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:24.761071 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e283de90-cb44-4af2-9ece-f3870b2105f3 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:24.761499 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e283de90-cb44-4af2-9ece-f3870b2105f3 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:24.963479 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e283de90-cb44-4af2-9ece-f3870b2105f3 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:24.971663 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e283de90-cb44-4af2-9ece-f3870b2105f3 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1315 microversion: 2.1 time: 0.225509 Sep 26 05:40:24.972516 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 617/1211] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:24 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:25.996638 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5c192f13-2374-489b-a4a9-d1fc51d325dd tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:25.997458 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5c192f13-2374-489b-a4a9-d1fc51d325dd tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:26.006898 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5c192f13-2374-489b-a4a9-d1fc51d325dd tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:26.007393 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5c192f13-2374-489b-a4a9-d1fc51d325dd tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:26.007879 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5c192f13-2374-489b-a4a9-d1fc51d325dd tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:26.009563 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5c192f13-2374-489b-a4a9-d1fc51d325dd tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:26.010027 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5c192f13-2374-489b-a4a9-d1fc51d325dd tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:26.010526 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5c192f13-2374-489b-a4a9-d1fc51d325dd tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:26.197621 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5c192f13-2374-489b-a4a9-d1fc51d325dd tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:26.205416 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5c192f13-2374-489b-a4a9-d1fc51d325dd tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1315 microversion: 2.1 time: 0.213599 Sep 26 05:40:26.206074 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 595/1212] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:25 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:27.228322 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-53c6024b-1e33-4a0b-a161-df15968e4a6e tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:27.229070 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-53c6024b-1e33-4a0b-a161-df15968e4a6e tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:27.236226 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-53c6024b-1e33-4a0b-a161-df15968e4a6e tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:27.236226 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-53c6024b-1e33-4a0b-a161-df15968e4a6e tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:27.236226 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-53c6024b-1e33-4a0b-a161-df15968e4a6e tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:27.236226 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-53c6024b-1e33-4a0b-a161-df15968e4a6e tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:27.239961 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-53c6024b-1e33-4a0b-a161-df15968e4a6e tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:27.239961 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-53c6024b-1e33-4a0b-a161-df15968e4a6e tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:27.484126 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-53c6024b-1e33-4a0b-a161-df15968e4a6e tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:27.492805 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-53c6024b-1e33-4a0b-a161-df15968e4a6e tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1465 microversion: 2.1 time: 0.268773 Sep 26 05:40:27.493380 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 618/1213] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:27 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1465 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:27.540071 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9eb95cdc-c0ae-46f8-830f-7fa3f0c15d45 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:27.540718 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9eb95cdc-c0ae-46f8-830f-7fa3f0c15d45 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:27.547182 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9eb95cdc-c0ae-46f8-830f-7fa3f0c15d45 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:27.547738 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9eb95cdc-c0ae-46f8-830f-7fa3f0c15d45 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:27.548244 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9eb95cdc-c0ae-46f8-830f-7fa3f0c15d45 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:27.549020 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9eb95cdc-c0ae-46f8-830f-7fa3f0c15d45 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:27.550106 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9eb95cdc-c0ae-46f8-830f-7fa3f0c15d45 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:27.550713 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9eb95cdc-c0ae-46f8-830f-7fa3f0c15d45 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:27.576144 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9eb95cdc-c0ae-46f8-830f-7fa3f0c15d45 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Going to try to terminate instance {{(pid=120805) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:40:27.611107 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:27.658639 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9eb95cdc-c0ae-46f8-830f-7fa3f0c15d45 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "DELETE /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 204 len: 0 microversion: 2.1 time: 0.122134 Sep 26 05:40:27.659333 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 596/1214] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:40:27 2022] DELETE /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:40:27.668398 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-5348d3ac-ffb6-4850-88b2-58cc4ccc0472 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:27.669019 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-5348d3ac-ffb6-4850-88b2-58cc4ccc0472 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:27.675849 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5348d3ac-ffb6-4850-88b2-58cc4ccc0472 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:27.676360 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5348d3ac-ffb6-4850-88b2-58cc4ccc0472 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:27.676801 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5348d3ac-ffb6-4850-88b2-58cc4ccc0472 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:27.677500 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5348d3ac-ffb6-4850-88b2-58cc4ccc0472 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:27.677955 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5348d3ac-ffb6-4850-88b2-58cc4ccc0472 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:27.678378 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-5348d3ac-ffb6-4850-88b2-58cc4ccc0472 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:27.894108 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-5348d3ac-ffb6-4850-88b2-58cc4ccc0472 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:27.902018 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-5348d3ac-ffb6-4850-88b2-58cc4ccc0472 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1471 microversion: 2.1 time: 0.237551 Sep 26 05:40:27.902515 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 619/1215] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:27 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1471 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:28.926789 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2234cd77-1367-4ba4-976a-f1b220288a7a tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:28.927491 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2234cd77-1367-4ba4-976a-f1b220288a7a tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:28.934054 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2234cd77-1367-4ba4-976a-f1b220288a7a tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:28.934535 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2234cd77-1367-4ba4-976a-f1b220288a7a tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:28.935016 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2234cd77-1367-4ba4-976a-f1b220288a7a tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:28.935686 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2234cd77-1367-4ba4-976a-f1b220288a7a tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:28.936137 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2234cd77-1367-4ba4-976a-f1b220288a7a tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:28.936587 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2234cd77-1367-4ba4-976a-f1b220288a7a tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:29.104740 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2234cd77-1367-4ba4-976a-f1b220288a7a tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:29.115354 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2234cd77-1367-4ba4-976a-f1b220288a7a tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1471 microversion: 2.1 time: 0.193322 Sep 26 05:40:29.115942 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 597/1216] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:28 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1471 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:30.058757 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-8334c2c3-8bdd-40ca-a9c9-e5a688647764 req-3f17d5d9-ce81-4890-bb7b-27ec39c85b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afab04cf-716e-47ea-a651-58d52da6a017", "name": "network-vif-deleted", "tag": "3c3c2e99-bc02-48cd-9404-484d9c459608"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:40:30.099969 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-8334c2c3-8bdd-40ca-a9c9-e5a688647764 req-3f17d5d9-ce81-4890-bb7b-27ec39c85b22 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:30.100519 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-8334c2c3-8bdd-40ca-a9c9-e5a688647764 req-3f17d5d9-ce81-4890-bb7b-27ec39c85b22 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:30.101124 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-8334c2c3-8bdd-40ca-a9c9-e5a688647764 req-3f17d5d9-ce81-4890-bb7b-27ec39c85b22 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:30.116627 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-8334c2c3-8bdd-40ca-a9c9-e5a688647764 req-3f17d5d9-ce81-4890-bb7b-27ec39c85b22 service nova] Creating event network-vif-deleted:3c3c2e99-bc02-48cd-9404-484d9c459608 for instance afab04cf-716e-47ea-a651-58d52da6a017 on hv-cinder-85918 Sep 26 05:40:30.121877 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-8334c2c3-8bdd-40ca-a9c9-e5a688647764 req-3f17d5d9-ce81-4890-bb7b-27ec39c85b22 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066632 Sep 26 05:40:30.122969 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 620/1217] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:40:30.140718 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-289c09e6-9683-4eee-8706-b04975929fd8 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:30.141494 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-289c09e6-9683-4eee-8706-b04975929fd8 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:30.149772 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-289c09e6-9683-4eee-8706-b04975929fd8 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:30.150555 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-289c09e6-9683-4eee-8706-b04975929fd8 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:30.151267 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-289c09e6-9683-4eee-8706-b04975929fd8 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:30.152465 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-289c09e6-9683-4eee-8706-b04975929fd8 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:30.153129 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-289c09e6-9683-4eee-8706-b04975929fd8 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:30.153992 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-289c09e6-9683-4eee-8706-b04975929fd8 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:30.231293 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-289c09e6-9683-4eee-8706-b04975929fd8 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d27aeb98d394e50b2ecf45e63b10486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4443d3eb0c4540419fe86007491b169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:40:30.239707 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-289c09e6-9683-4eee-8706-b04975929fd8 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 200 len: 1300 microversion: 2.1 time: 0.103990 Sep 26 05:40:30.254055 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 598/1218] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:30 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 1300 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:40:31.263461 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-91f6d350-ecbd-419b-9321-806ffabed482 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:40:31.264160 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-91f6d350-ecbd-419b-9321-806ffabed482 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] [instance: afab04cf-716e-47ea-a651-58d52da6a017] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:40:31.273495 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-91f6d350-ecbd-419b-9321-806ffabed482 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:31.273988 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-91f6d350-ecbd-419b-9321-806ffabed482 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:31.274429 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-91f6d350-ecbd-419b-9321-806ffabed482 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:31.275136 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-91f6d350-ecbd-419b-9321-806ffabed482 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:40:31.275722 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-91f6d350-ecbd-419b-9321-806ffabed482 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:40:31.276157 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-91f6d350-ecbd-419b-9321-806ffabed482 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:40:31.290240 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-91f6d350-ecbd-419b-9321-806ffabed482 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] HTTP exception thrown: Instance afab04cf-716e-47ea-a651-58d52da6a017 could not be found. Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-91f6d350-ecbd-419b-9321-806ffabed482 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Request method failure captured: Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 HTTP/1.1 Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTszH1aefJlFesifOzuoLXZXVhTB2qhX4u5HincAlJOPjpao1T0EBcNv9u-GpClYR_4DK-hFEHi-P1ceooymoDlHtDx1ZJRcqHyckiWWb6ElU4_CgqLQ4KrWWeQ9jdT00Mh57XBJON-YybcUSo6txS_vgOmem1h7xRBUH3DejTZlldw Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: 4443d3eb0c4540419fe86007491b169b Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-VolumesNegativeTest-871364725 Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:40:31.291912 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:40:31.293464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4443d3eb0c4540419fe86007491b169b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4443d3eb0c4540419fe86007491b169b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4443d3eb0c4540419fe86007491b169b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4443d3eb0c4540419fe86007491b169b"}]}] Sep 26 05:40:31.293464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-VolumesNegativeTest-871364725 Sep 26 05:40:31.293464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: 4443d3eb0c4540419fe86007491b169b Sep 26 05:40:31.293464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-VolumesNegativeTest-871364725 Sep 26 05:40:31.293464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-VolumesNegativeTest-871364725-project Sep 26 05:40:31.293464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:40:31.293464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:40:31.293464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 7d27aeb98d394e50b2ecf45e63b10486 Sep 26 05:40:31.293464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-VolumesNegativeTest-871364725-project Sep 26 05:40:31.293464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:40:31.293464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance afab04cf-716e-47ea-a651-58d52da6a017 could not be found. Sep 26 05:40:31.293464 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': 'afab04cf-716e-47ea-a651-58d52da6a017'} Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afab04cf-716e-47ea-a651-58d52da6a017 could not be found. Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:40:31.294890 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:40:31.296327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:40:31.296327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:40:31.296327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:40:31.296327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:40:31.296327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:40:31.296327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:40:31.296327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:40:31.296327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afab04cf-716e-47ea-a651-58d52da6a017 could not be found. Sep 26 05:40:31.296327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:40:31.296327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:40:31.296327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:40:31.296327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:40:31.296327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:40:31.296327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:40:31.296327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:40:31.296327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:40:31.296327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afab04cf-716e-47ea-a651-58d52da6a017 could not be found. Sep 26 05:40:31.296327 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:40:31.298164 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-91f6d350-ecbd-419b-9321-806ffabed482 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] Returning 404 to user: Instance afab04cf-716e-47ea-a651-58d52da6a017 could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:40:31.298164 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-91f6d350-ecbd-419b-9321-806ffabed482 tempest-VolumesNegativeTest-871364725 tempest-VolumesNegativeTest-871364725-project] 10.222.0.49 "GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017" status: 404 len: 111 microversion: 2.1 time: 0.034119 Sep 26 05:40:31.298164 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 621/1219] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:40:31 2022] GET /compute/v2.1/servers/afab04cf-716e-47ea-a651-58d52da6a017 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:41:55.683756 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b2be48d0-0624-4d7a-8f50-389b84da586e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:41:55.684351 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_api:SELECT=15 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:55.684768 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b2be48d0-0624-4d7a-8f50-389b84da586e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:41:55.684989 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG dbcounter [-] [120806] Writing DB stats nova_cell1:SELECT=88 {{(pid=120806) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:55.686939 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:55.687861 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:55.691360 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-a01b2387-ab41-437d-8165-d4eccdb3c892 req-443032cc-b3fe-4e6d-a850-9a8eb1965fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c532b0-9ad5-4519-ad88-2b61859b648f", "tag": "19481f78-5754-457c-8919-13eca736d5eb"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:41:55.696300 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b2be48d0-0624-4d7a-8f50-389b84da586e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:41:55.696793 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b2be48d0-0624-4d7a-8f50-389b84da586e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:41:55.697478 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b2be48d0-0624-4d7a-8f50-389b84da586e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:41:55.698361 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b2be48d0-0624-4d7a-8f50-389b84da586e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:41:55.698990 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b2be48d0-0624-4d7a-8f50-389b84da586e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:41:55.699417 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b2be48d0-0624-4d7a-8f50-389b84da586e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:41:55.702704 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-a01b2387-ab41-437d-8165-d4eccdb3c892 req-443032cc-b3fe-4e6d-a850-9a8eb1965fa2 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:41:55.703178 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-a01b2387-ab41-437d-8165-d4eccdb3c892 req-443032cc-b3fe-4e6d-a850-9a8eb1965fa2 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:41:55.703605 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-a01b2387-ab41-437d-8165-d4eccdb3c892 req-443032cc-b3fe-4e6d-a850-9a8eb1965fa2 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:41:55.716811 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-a01b2387-ab41-437d-8165-d4eccdb3c892 req-443032cc-b3fe-4e6d-a850-9a8eb1965fa2 service nova] Creating event network-changed:19481f78-5754-457c-8919-13eca736d5eb for instance 05c532b0-9ad5-4519-ad88-2b61859b648f on hv-cinder-85918 Sep 26 05:41:55.722372 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-a01b2387-ab41-437d-8165-d4eccdb3c892 req-443032cc-b3fe-4e6d-a850-9a8eb1965fa2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039860 Sep 26 05:41:55.722968 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 622/1220] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:41:55.731345 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b2be48d0-0624-4d7a-8f50-389b84da586e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Going to try to terminate instance {{(pid=120805) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:41:55.832011 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b2be48d0-0624-4d7a-8f50-389b84da586e tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "DELETE /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 204 len: 0 microversion: 2.1 time: 0.152905 Sep 26 05:41:55.832872 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 599/1221] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:41:55 2022] DELETE /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:41:55.842165 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-6e9b6a82-9f61-4a20-9688-9aaf93d039af tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:41:55.842958 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-6e9b6a82-9f61-4a20-9688-9aaf93d039af tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:41:55.849501 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6e9b6a82-9f61-4a20-9688-9aaf93d039af tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:41:55.849995 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6e9b6a82-9f61-4a20-9688-9aaf93d039af tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:41:55.850471 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6e9b6a82-9f61-4a20-9688-9aaf93d039af tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:41:55.851850 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6e9b6a82-9f61-4a20-9688-9aaf93d039af tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:41:55.852343 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6e9b6a82-9f61-4a20-9688-9aaf93d039af tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:41:55.852791 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-6e9b6a82-9f61-4a20-9688-9aaf93d039af tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:41:55.995901 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-6e9b6a82-9f61-4a20-9688-9aaf93d039af tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:41:56.003699 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-6e9b6a82-9f61-4a20-9688-9aaf93d039af tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1578 microversion: 2.1 time: 0.165837 Sep 26 05:41:56.004288 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 623/1222] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:41:55 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:41:57.029592 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-547152c4-1e3d-40e2-b3f6-c2e9f5fb39ec tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:41:57.030298 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-547152c4-1e3d-40e2-b3f6-c2e9f5fb39ec tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:41:57.036983 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-547152c4-1e3d-40e2-b3f6-c2e9f5fb39ec tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:41:57.037469 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-547152c4-1e3d-40e2-b3f6-c2e9f5fb39ec tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:41:57.037967 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-547152c4-1e3d-40e2-b3f6-c2e9f5fb39ec tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:41:57.038909 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-547152c4-1e3d-40e2-b3f6-c2e9f5fb39ec tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:41:57.039368 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-547152c4-1e3d-40e2-b3f6-c2e9f5fb39ec tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:41:57.039799 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-547152c4-1e3d-40e2-b3f6-c2e9f5fb39ec tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:41:57.175894 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-547152c4-1e3d-40e2-b3f6-c2e9f5fb39ec tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:41:57.183762 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-547152c4-1e3d-40e2-b3f6-c2e9f5fb39ec tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1578 microversion: 2.1 time: 0.158543 Sep 26 05:41:57.184337 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 600/1223] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:41:57 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:41:57.896326 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-3728a54a-83aa-4d56-8ca2-f0a230b9792c req-e7e84f11-7447-4e42-b6fb-0b6fc38e2c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c532b0-9ad5-4519-ad88-2b61859b648f", "name": "network-vif-deleted", "tag": "19481f78-5754-457c-8919-13eca736d5eb"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:41:57.907099 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-3728a54a-83aa-4d56-8ca2-f0a230b9792c req-e7e84f11-7447-4e42-b6fb-0b6fc38e2c2c service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:41:57.907570 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-3728a54a-83aa-4d56-8ca2-f0a230b9792c req-e7e84f11-7447-4e42-b6fb-0b6fc38e2c2c service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:41:57.908059 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-3728a54a-83aa-4d56-8ca2-f0a230b9792c req-e7e84f11-7447-4e42-b6fb-0b6fc38e2c2c service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:41:57.919897 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-3728a54a-83aa-4d56-8ca2-f0a230b9792c req-e7e84f11-7447-4e42-b6fb-0b6fc38e2c2c service nova] Creating event network-vif-deleted:19481f78-5754-457c-8919-13eca736d5eb for instance 05c532b0-9ad5-4519-ad88-2b61859b648f on hv-cinder-85918 Sep 26 05:41:57.925286 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-3728a54a-83aa-4d56-8ca2-f0a230b9792c req-e7e84f11-7447-4e42-b6fb-0b6fc38e2c2c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033188 Sep 26 05:41:57.925951 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 624/1224] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:41:58.207397 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-304aadde-eba4-451c-8e8d-48a35cda153f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:41:58.208173 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-304aadde-eba4-451c-8e8d-48a35cda153f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:41:58.215886 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-304aadde-eba4-451c-8e8d-48a35cda153f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:41:58.216467 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-304aadde-eba4-451c-8e8d-48a35cda153f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:41:58.216905 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-304aadde-eba4-451c-8e8d-48a35cda153f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:41:58.218778 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-304aadde-eba4-451c-8e8d-48a35cda153f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:41:58.219267 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-304aadde-eba4-451c-8e8d-48a35cda153f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:41:58.219709 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-304aadde-eba4-451c-8e8d-48a35cda153f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:41:58.289519 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-304aadde-eba4-451c-8e8d-48a35cda153f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:41:58.297834 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-304aadde-eba4-451c-8e8d-48a35cda153f tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 200 len: 1225 microversion: 2.1 time: 0.094396 Sep 26 05:41:58.298421 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 601/1225] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:41:58 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:41:59.324550 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-949f8e36-6c61-4cb5-91f4-2dcf75737a59 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:41:59.325257 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-949f8e36-6c61-4cb5-91f4-2dcf75737a59 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 05c532b0-9ad5-4519-ad88-2b61859b648f] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:41:59.331500 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-949f8e36-6c61-4cb5-91f4-2dcf75737a59 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:41:59.331988 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-949f8e36-6c61-4cb5-91f4-2dcf75737a59 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:41:59.332462 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-949f8e36-6c61-4cb5-91f4-2dcf75737a59 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:41:59.333160 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-949f8e36-6c61-4cb5-91f4-2dcf75737a59 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:41:59.333614 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-949f8e36-6c61-4cb5-91f4-2dcf75737a59 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:41:59.334043 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-949f8e36-6c61-4cb5-91f4-2dcf75737a59 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:41:59.349086 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-949f8e36-6c61-4cb5-91f4-2dcf75737a59 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] HTTP exception thrown: Instance 05c532b0-9ad5-4519-ad88-2b61859b648f could not be found. Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-949f8e36-6c61-4cb5-91f4-2dcf75737a59 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Request method failure captured: Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f HTTP/1.1 Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTnOXhzRVI6npHC9kXb00MocY9EEo6wyShvEH072rcUp5NBGcYDNbn0nRgd45nslLibbJg58_w54gNPux1kdyYdDTf04AugTlN2OdgatBlbYhju0z67J2dnenyukSMD1EVuK-oUKMclPcP68ZhX5y_B14wjkvbdjVxe8wf7xsC_oM7s Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: 774c63ee5fc74c619f63c64590c154e4 Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-TestVolumeBootPattern-597728443 Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:41:59.351493 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:41:59.353409 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/774c63ee5fc74c619f63c64590c154e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/774c63ee5fc74c619f63c64590c154e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/774c63ee5fc74c619f63c64590c154e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_774c63ee5fc74c619f63c64590c154e4"}]}] Sep 26 05:41:59.353409 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-TestVolumeBootPattern-597728443 Sep 26 05:41:59.353409 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: 774c63ee5fc74c619f63c64590c154e4 Sep 26 05:41:59.353409 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-TestVolumeBootPattern-597728443 Sep 26 05:41:59.353409 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-TestVolumeBootPattern-597728443-project Sep 26 05:41:59.353409 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:41:59.353409 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:41:59.353409 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 57daecc890ac421b8eb7b5fb4bf25411 Sep 26 05:41:59.353409 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-TestVolumeBootPattern-597728443-project Sep 26 05:41:59.353409 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:41:59.353409 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance 05c532b0-9ad5-4519-ad88-2b61859b648f could not be found. Sep 26 05:41:59.353409 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': '05c532b0-9ad5-4519-ad88-2b61859b648f'} Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c532b0-9ad5-4519-ad88-2b61859b648f could not be found. Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:41:59.354424 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:41:59.356139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:41:59.356139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:41:59.356139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:41:59.356139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:41:59.356139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:41:59.356139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:41:59.356139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:41:59.356139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c532b0-9ad5-4519-ad88-2b61859b648f could not be found. Sep 26 05:41:59.356139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:41:59.356139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:41:59.356139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:41:59.356139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:41:59.356139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:41:59.356139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:41:59.356139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:41:59.356139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:41:59.356139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c532b0-9ad5-4519-ad88-2b61859b648f could not be found. Sep 26 05:41:59.356139 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:41:59.357684 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-949f8e36-6c61-4cb5-91f4-2dcf75737a59 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Returning 404 to user: Instance 05c532b0-9ad5-4519-ad88-2b61859b648f could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:41:59.357684 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-949f8e36-6c61-4cb5-91f4-2dcf75737a59 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f" status: 404 len: 111 microversion: 2.1 time: 0.033086 Sep 26 05:41:59.357684 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 625/1226] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:41:59 2022] GET /compute/v2.1/servers/05c532b0-9ad5-4519-ad88-2b61859b648f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:42:02.407235 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-fbe0c948-b434-43f3-acfc-640dc71c0e4c req-ed953a71-6f8b-47c5-b742-77f225314094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6a2248-68b0-4336-ade5-c6c3b756cdae", "tag": "e47ebac1-d877-4ac1-8e2f-fb371cb2f895"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:42:02.414419 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8611a43d-6637-4991-a32c-39efef445342 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:42:02.414923 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8611a43d-6637-4991-a32c-39efef445342 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:42:02.421147 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8611a43d-6637-4991-a32c-39efef445342 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:02.421637 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8611a43d-6637-4991-a32c-39efef445342 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:02.421760 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-fbe0c948-b434-43f3-acfc-640dc71c0e4c req-ed953a71-6f8b-47c5-b742-77f225314094 service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:02.422071 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8611a43d-6637-4991-a32c-39efef445342 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:02.422237 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-fbe0c948-b434-43f3-acfc-640dc71c0e4c req-ed953a71-6f8b-47c5-b742-77f225314094 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:02.422668 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-fbe0c948-b434-43f3-acfc-640dc71c0e4c req-ed953a71-6f8b-47c5-b742-77f225314094 service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:02.423164 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8611a43d-6637-4991-a32c-39efef445342 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:02.423627 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8611a43d-6637-4991-a32c-39efef445342 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:02.424054 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8611a43d-6637-4991-a32c-39efef445342 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:02.435170 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-fbe0c948-b434-43f3-acfc-640dc71c0e4c req-ed953a71-6f8b-47c5-b742-77f225314094 service nova] Creating event network-changed:e47ebac1-d877-4ac1-8e2f-fb371cb2f895 for instance 1e6a2248-68b0-4336-ade5-c6c3b756cdae on hv-cinder-85918 Sep 26 05:42:02.440135 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-fbe0c948-b434-43f3-acfc-640dc71c0e4c req-ed953a71-6f8b-47c5-b742-77f225314094 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038971 Sep 26 05:42:02.440971 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 626/1227] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:42:02.451525 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8611a43d-6637-4991-a32c-39efef445342 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Going to try to terminate instance {{(pid=120805) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:42:02.539765 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8611a43d-6637-4991-a32c-39efef445342 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 204 len: 0 microversion: 2.1 time: 0.140233 Sep 26 05:42:02.543656 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 602/1228] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:42:02 2022] DELETE /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:42:02.550189 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-e11ea04e-76bb-4707-90d9-4bdef6626de7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:42:02.550994 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-e11ea04e-76bb-4707-90d9-4bdef6626de7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:42:02.558567 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e11ea04e-76bb-4707-90d9-4bdef6626de7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:02.559062 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e11ea04e-76bb-4707-90d9-4bdef6626de7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:02.559507 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e11ea04e-76bb-4707-90d9-4bdef6626de7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:02.560282 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e11ea04e-76bb-4707-90d9-4bdef6626de7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:02.560964 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e11ea04e-76bb-4707-90d9-4bdef6626de7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:02.561565 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-e11ea04e-76bb-4707-90d9-4bdef6626de7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:02.702854 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.policy [None req-e11ea04e-76bb-4707-90d9-4bdef6626de7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120806) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:42:02.711498 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-e11ea04e-76bb-4707-90d9-4bdef6626de7 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1578 microversion: 2.1 time: 0.166239 Sep 26 05:42:02.712076 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 627/1229] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:42:02 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:42:03.736718 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-737c9330-3961-4eb1-9250-3fc9b43d8f45 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:42:03.738026 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-737c9330-3961-4eb1-9250-3fc9b43d8f45 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:42:03.745370 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-737c9330-3961-4eb1-9250-3fc9b43d8f45 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:03.745861 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-737c9330-3961-4eb1-9250-3fc9b43d8f45 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:03.746302 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-737c9330-3961-4eb1-9250-3fc9b43d8f45 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:03.747002 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-737c9330-3961-4eb1-9250-3fc9b43d8f45 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:03.747458 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-737c9330-3961-4eb1-9250-3fc9b43d8f45 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:03.747884 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-737c9330-3961-4eb1-9250-3fc9b43d8f45 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:03.884972 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-737c9330-3961-4eb1-9250-3fc9b43d8f45 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:42:03.893254 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-737c9330-3961-4eb1-9250-3fc9b43d8f45 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1578 microversion: 2.1 time: 0.160676 Sep 26 05:42:03.894488 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 603/1230] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:42:03 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:42:04.493202 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [req-5c4140d3-5d12-44ae-9cda-2b69d1d52b32 req-8d0418ad-680f-44a8-943c-3d80be5eb85c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6a2248-68b0-4336-ade5-c6c3b756cdae", "name": "network-vif-deleted", "tag": "e47ebac1-d877-4ac1-8e2f-fb371cb2f895"}]} {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:42:04.505904 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-5c4140d3-5d12-44ae-9cda-2b69d1d52b32 req-8d0418ad-680f-44a8-943c-3d80be5eb85c service nova] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:04.506387 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-5c4140d3-5d12-44ae-9cda-2b69d1d52b32 req-8d0418ad-680f-44a8-943c-3d80be5eb85c service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:04.506821 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [req-5c4140d3-5d12-44ae-9cda-2b69d1d52b32 req-8d0418ad-680f-44a8-943c-3d80be5eb85c service nova] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:04.519968 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.compute.server_external_events [req-5c4140d3-5d12-44ae-9cda-2b69d1d52b32 req-8d0418ad-680f-44a8-943c-3d80be5eb85c service nova] Creating event network-vif-deleted:e47ebac1-d877-4ac1-8e2f-fb371cb2f895 for instance 1e6a2248-68b0-4336-ade5-c6c3b756cdae on hv-cinder-85918 Sep 26 05:42:04.526637 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [req-5c4140d3-5d12-44ae-9cda-2b69d1d52b32 req-8d0418ad-680f-44a8-943c-3d80be5eb85c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037121 Sep 26 05:42:04.527225 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 628/1231] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 05:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:42:04.918045 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c18029e9-1618-472c-945b-3c916cf6ec4b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:42:04.918658 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c18029e9-1618-472c-945b-3c916cf6ec4b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:42:04.924864 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c18029e9-1618-472c-945b-3c916cf6ec4b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:04.925347 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c18029e9-1618-472c-945b-3c916cf6ec4b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:04.925777 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c18029e9-1618-472c-945b-3c916cf6ec4b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:04.926456 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c18029e9-1618-472c-945b-3c916cf6ec4b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:04.926905 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c18029e9-1618-472c-945b-3c916cf6ec4b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:04.931937 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c18029e9-1618-472c-945b-3c916cf6ec4b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:04.965782 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c18029e9-1618-472c-945b-3c916cf6ec4b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:04.966177 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c18029e9-1618-472c-945b-3c916cf6ec4b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:04.966605 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c18029e9-1618-472c-945b-3c916cf6ec4b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:04.967045 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-c18029e9-1618-472c-945b-3c916cf6ec4b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lazy-loading 'fault' on Instance uuid 1e6a2248-68b0-4336-ade5-c6c3b756cdae {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:42:05.007699 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c18029e9-1618-472c-945b-3c916cf6ec4b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57daecc890ac421b8eb7b5fb4bf25411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774c63ee5fc74c619f63c64590c154e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:42:05.017161 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c18029e9-1618-472c-945b-3c916cf6ec4b tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 200 len: 1230 microversion: 2.1 time: 0.102936 Sep 26 05:42:05.017659 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 604/1232] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:42:04 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:42:06.040672 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7643f795-94bd-4f05-9310-eedda7d9e405 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:42:06.041384 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-7643f795-94bd-4f05-9310-eedda7d9e405 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: 1e6a2248-68b0-4336-ade5-c6c3b756cdae] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:42:06.047539 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7643f795-94bd-4f05-9310-eedda7d9e405 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:06.048017 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7643f795-94bd-4f05-9310-eedda7d9e405 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:06.048488 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7643f795-94bd-4f05-9310-eedda7d9e405 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:06.049167 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7643f795-94bd-4f05-9310-eedda7d9e405 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:06.049615 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7643f795-94bd-4f05-9310-eedda7d9e405 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:06.050033 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-7643f795-94bd-4f05-9310-eedda7d9e405 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:06.062798 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-7643f795-94bd-4f05-9310-eedda7d9e405 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] HTTP exception thrown: Instance 1e6a2248-68b0-4336-ade5-c6c3b756cdae could not be found. Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7643f795-94bd-4f05-9310-eedda7d9e405 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Request method failure captured: Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae HTTP/1.1 Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTnOXhzRVI6npHC9kXb00MocY9EEo6wyShvEH072rcUp5NBGcYDNbn0nRgd45nslLibbJg58_w54gNPux1kdyYdDTf04AugTlN2OdgatBlbYhju0z67J2dnenyukSMD1EVuK-oUKMclPcP68ZhX5y_B14wjkvbdjVxe8wf7xsC_oM7s Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: 774c63ee5fc74c619f63c64590c154e4 Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-TestVolumeBootPattern-597728443 Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:42:06.064416 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:42:06.066153 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/774c63ee5fc74c619f63c64590c154e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/774c63ee5fc74c619f63c64590c154e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/774c63ee5fc74c619f63c64590c154e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_774c63ee5fc74c619f63c64590c154e4"}]}] Sep 26 05:42:06.066153 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-TestVolumeBootPattern-597728443 Sep 26 05:42:06.066153 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: 774c63ee5fc74c619f63c64590c154e4 Sep 26 05:42:06.066153 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-TestVolumeBootPattern-597728443 Sep 26 05:42:06.066153 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-TestVolumeBootPattern-597728443-project Sep 26 05:42:06.066153 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:42:06.066153 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:42:06.066153 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 57daecc890ac421b8eb7b5fb4bf25411 Sep 26 05:42:06.066153 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-TestVolumeBootPattern-597728443-project Sep 26 05:42:06.066153 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:42:06.066153 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance 1e6a2248-68b0-4336-ade5-c6c3b756cdae could not be found. Sep 26 05:42:06.066153 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': '1e6a2248-68b0-4336-ade5-c6c3b756cdae'} Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e6a2248-68b0-4336-ade5-c6c3b756cdae could not be found. Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:42:06.067163 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:42:06.068943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:42:06.068943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:42:06.068943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:42:06.068943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:42:06.068943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:42:06.068943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:42:06.068943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:42:06.068943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e6a2248-68b0-4336-ade5-c6c3b756cdae could not be found. Sep 26 05:42:06.068943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:42:06.068943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:42:06.068943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:42:06.068943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:42:06.068943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:42:06.068943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:42:06.068943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:42:06.068943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:42:06.068943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e6a2248-68b0-4336-ade5-c6c3b756cdae could not be found. Sep 26 05:42:06.068943 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:42:06.070483 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-7643f795-94bd-4f05-9310-eedda7d9e405 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Returning 404 to user: Instance 1e6a2248-68b0-4336-ade5-c6c3b756cdae could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:42:06.070483 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-7643f795-94bd-4f05-9310-eedda7d9e405 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae" status: 404 len: 111 microversion: 2.1 time: 0.029629 Sep 26 05:42:06.070483 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 629/1233] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:42:06 2022] GET /compute/v2.1/servers/1e6a2248-68b0-4336-ade5-c6c3b756cdae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:42:06.496481 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-49a48670-78f1-4a41-8588-57ab77c2e1ed tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:42:06.497148 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-49a48670-78f1-4a41-8588-57ab77c2e1ed tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:42:06.503619 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-49a48670-78f1-4a41-8588-57ab77c2e1ed tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:06.504106 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-49a48670-78f1-4a41-8588-57ab77c2e1ed tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:06.504582 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-49a48670-78f1-4a41-8588-57ab77c2e1ed tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:06.505279 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-49a48670-78f1-4a41-8588-57ab77c2e1ed tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:06.505738 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-49a48670-78f1-4a41-8588-57ab77c2e1ed tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:06.506167 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-49a48670-78f1-4a41-8588-57ab77c2e1ed tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:06.520194 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-49a48670-78f1-4a41-8588-57ab77c2e1ed tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] HTTP exception thrown: Instance d690507f-f032-475f-b4c4-4f5274841bf9 could not be found. Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-49a48670-78f1-4a41-8588-57ab77c2e1ed tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Request method failure captured: Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: request: DELETE /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 HTTP/1.1 Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Connection: close Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Host: 10.222.0.49 Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjMTnOXhzRVI6npHC9kXb00MocY9EEo6wyShvEH072rcUp5NBGcYDNbn0nRgd45nslLibbJg58_w54gNPux1kdyYdDTf04AugTlN2OdgatBlbYhju0z67J2dnenyukSMD1EVuK-oUKMclPcP68ZhX5y_B14wjkvbdjVxe8wf7xsC_oM7s Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Id: 774c63ee5fc74c619f63c64590c154e4 Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-TestVolumeBootPattern-597728443 Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Role: reader,member Sep 26 05:42:06.521842 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Roles: reader,member Sep 26 05:42:06.523534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/774c63ee5fc74c619f63c64590c154e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/774c63ee5fc74c619f63c64590c154e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/774c63ee5fc74c619f63c64590c154e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_774c63ee5fc74c619f63c64590c154e4"}]}] Sep 26 05:42:06.523534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-TestVolumeBootPattern-597728443 Sep 26 05:42:06.523534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 774c63ee5fc74c619f63c64590c154e4 Sep 26 05:42:06.523534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-TestVolumeBootPattern-597728443 Sep 26 05:42:06.523534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User: tempest-TestVolumeBootPattern-597728443-project Sep 26 05:42:06.523534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 26 05:42:06.523534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 26 05:42:06.523534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Id: 57daecc890ac421b8eb7b5fb4bf25411 Sep 26 05:42:06.523534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-TestVolumeBootPattern-597728443-project Sep 26 05:42:06.523534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: method: > Sep 26 05:42:06.523534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: exception: Instance d690507f-f032-475f-b4c4-4f5274841bf9 could not be found. Sep 26 05:42:06.523534 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: action_args: {'id': 'd690507f-f032-475f-b4c4-4f5274841bf9'} Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d690507f-f032-475f-b4c4-4f5274841bf9 could not be found. Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:42:06.525335 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d690507f-f032-475f-b4c4-4f5274841bf9 could not be found. Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d690507f-f032-475f-b4c4-4f5274841bf9 could not be found. Sep 26 05:42:06.526936 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 26 05:42:06.528946 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-49a48670-78f1-4a41-8588-57ab77c2e1ed tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Returning 404 to user: Instance d690507f-f032-475f-b4c4-4f5274841bf9 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:42:06.528946 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-49a48670-78f1-4a41-8588-57ab77c2e1ed tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 404 len: 111 microversion: 2.1 time: 0.030978 Sep 26 05:42:06.528946 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 605/1234] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 05:42:06 2022] DELETE /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:42:06.532299 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-977bc544-1899-4894-958c-9e8358bed5ca tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '>' {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:42:06.532926 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.compute.api [None req-977bc544-1899-4894-958c-9e8358bed5ca tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] [instance: d690507f-f032-475f-b4c4-4f5274841bf9] Fetching instance by UUID {{(pid=120806) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:42:06.538917 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-977bc544-1899-4894-958c-9e8358bed5ca tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:06.539390 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-977bc544-1899-4894-958c-9e8358bed5ca tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:06.539824 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-977bc544-1899-4894-958c-9e8358bed5ca tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:06.540548 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-977bc544-1899-4894-958c-9e8358bed5ca tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Acquiring lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:06.541008 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-977bc544-1899-4894-958c-9e8358bed5ca tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:06.541436 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG oslo_concurrency.lockutils [None req-977bc544-1899-4894-958c-9e8358bed5ca tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Lock "1f676b63-1e10-465f-9e48-7eb519e23a3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120806) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:06.554498 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.wsgi [None req-977bc544-1899-4894-958c-9e8358bed5ca tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] HTTP exception thrown: Instance d690507f-f032-475f-b4c4-4f5274841bf9 could not be found. Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-977bc544-1899-4894-958c-9e8358bed5ca tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Request method failure captured: Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: request: GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 HTTP/1.1 Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept: application/json Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Accept-Encoding: identity Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Connection: close Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Length: 0 Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Content-Type: application/json Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Host: 10.222.0.49 Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: Openstack-System-Scope: None Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: User-Agent: python-urllib3/1.26.12 Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Auth-Token: gAAAAABjMTnOXhzRVI6npHC9kXb00MocY9EEo6wyShvEH072rcUp5NBGcYDNbn0nRgd45nslLibbJg58_w54gNPux1kdyYdDTf04AugTlN2OdgatBlbYhju0z67J2dnenyukSMD1EVuK-oUKMclPcP68ZhX5y_B14wjkvbdjVxe8wf7xsC_oM7s Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Id: None Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Domain-Name: None Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Identity-Status: Confirmed Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Is-Admin-Project: True Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Id: default Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Domain-Name: Default Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Id: 774c63ee5fc74c619f63c64590c154e4 Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Project-Name: tempest-TestVolumeBootPattern-597728443 Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Role: reader,member Sep 26 05:42:06.556690 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Roles: reader,member Sep 26 05:42:06.562006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/774c63ee5fc74c619f63c64590c154e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/774c63ee5fc74c619f63c64590c154e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/774c63ee5fc74c619f63c64590c154e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_774c63ee5fc74c619f63c64590c154e4"}]}] Sep 26 05:42:06.562006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant: tempest-TestVolumeBootPattern-597728443 Sep 26 05:42:06.562006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Id: 774c63ee5fc74c619f63c64590c154e4 Sep 26 05:42:06.562006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-Tenant-Name: tempest-TestVolumeBootPattern-597728443 Sep 26 05:42:06.562006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User: tempest-TestVolumeBootPattern-597728443-project Sep 26 05:42:06.562006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Id: default Sep 26 05:42:06.562006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Domain-Name: Default Sep 26 05:42:06.562006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Id: 57daecc890ac421b8eb7b5fb4bf25411 Sep 26 05:42:06.562006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: X-User-Name: tempest-TestVolumeBootPattern-597728443-project Sep 26 05:42:06.562006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: method: > Sep 26 05:42:06.562006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: exception: Instance d690507f-f032-475f-b4c4-4f5274841bf9 could not be found. Sep 26 05:42:06.562006 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: action_args: {'id': 'd690507f-f032-475f-b4c4-4f5274841bf9'} Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: {{(pid=120806) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d690507f-f032-475f-b4c4-4f5274841bf9 could not be found. Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:42:06.563829 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:42:06.565948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:42:06.565948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:42:06.565948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:42:06.565948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:42:06.565948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:42:06.565948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:42:06.565948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:42:06.565948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d690507f-f032-475f-b4c4-4f5274841bf9 could not be found. Sep 26 05:42:06.565948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:42:06.565948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:42:06.565948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:42:06.565948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:42:06.565948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:42:06.565948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:42:06.565948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:42:06.565948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:42:06.565948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d690507f-f032-475f-b4c4-4f5274841bf9 could not be found. Sep 26 05:42:06.565948 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: ERROR nova.api.openstack.wsgi Sep 26 05:42:06.567460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: DEBUG nova.api.openstack.wsgi [None req-977bc544-1899-4894-958c-9e8358bed5ca tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Returning 404 to user: Instance d690507f-f032-475f-b4c4-4f5274841bf9 could not be found. {{(pid=120806) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:42:06.567460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: INFO nova.api.openstack.requestlog [None req-977bc544-1899-4894-958c-9e8358bed5ca tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9" status: 404 len: 111 microversion: 2.1 time: 0.029570 Sep 26 05:42:06.567460 dv-cinder-859186-2-iscsi devstack@n-api.service[120806]: [pid: 120806|app: 0|req: 630/1235] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 05:42:06 2022] GET /compute/v2.1/servers/d690507f-f032-475f-b4c4-4f5274841bf9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:42:07.848968 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2c5008a7-3cbd-4a36-a70a-300d74d00187 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] Calling method '.version_select at 0x7fd7b766c5e0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:42:07.872200 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2c5008a7-3cbd-4a36-a70a-300d74d00187 tempest-TestVolumeBootPattern-597728443 tempest-TestVolumeBootPattern-597728443-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-641338499" status: 202 len: 0 microversion: 2.1 time: 0.026847 Sep 26 05:42:07.872922 dv-cinder-859186-2-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 606/1236] 10.222.0.49 () {58 vars in 1260 bytes} [Mon Sep 26 05:42:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-641338499 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)